2023-07-20 15:10:15,689 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-20 15:10:15,950 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d 2023-07-20 15:10:15,950 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-20 15:10:15,992 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-20 15:10:16,240 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-20 15:10:16,241 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/cluster_360f6e79-b16a-b730-c2d8-9ed046e7a4b0, deleteOnExit=true 2023-07-20 15:10:16,241 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-20 15:10:16,242 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/test.cache.data in system properties and HBase conf 2023-07-20 15:10:16,242 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/hadoop.tmp.dir in system properties and HBase conf 2023-07-20 15:10:16,243 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/hadoop.log.dir in system properties and HBase conf 2023-07-20 15:10:16,243 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-20 15:10:16,244 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-20 15:10:16,244 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-20 15:10:16,610 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-20 15:10:16,616 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-20 15:10:16,617 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-20 15:10:16,618 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-20 15:10:16,618 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 15:10:16,619 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-20 15:10:16,619 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-20 15:10:16,619 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 15:10:16,620 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 15:10:16,620 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-20 15:10:16,621 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/nfs.dump.dir in system properties and HBase conf 2023-07-20 15:10:16,621 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/java.io.tmpdir in system properties and HBase conf 2023-07-20 15:10:16,622 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 15:10:16,622 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-20 15:10:16,622 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-20 15:10:17,248 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-20 15:10:17,253 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-20 15:10:17,544 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-20 15:10:17,737 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-20 15:10:17,752 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 15:10:17,790 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 15:10:17,822 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/java.io.tmpdir/Jetty_localhost_41163_hdfs____.l69kxx/webapp 2023-07-20 15:10:17,992 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41163 2023-07-20 15:10:18,032 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-20 15:10:18,032 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-20 15:10:18,615 WARN [Listener at localhost/34279] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 15:10:18,746 WARN [Listener at localhost/34279] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 15:10:18,770 WARN [Listener at localhost/34279] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 15:10:18,778 INFO [Listener at localhost/34279] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 15:10:18,786 INFO [Listener at localhost/34279] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/java.io.tmpdir/Jetty_localhost_40377_datanode____.4k2hj6/webapp 2023-07-20 15:10:18,931 INFO [Listener at localhost/34279] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40377 2023-07-20 15:10:19,449 WARN [Listener at localhost/36151] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 15:10:19,482 WARN [Listener at localhost/36151] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 15:10:19,490 WARN [Listener at localhost/36151] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 15:10:19,493 INFO [Listener at localhost/36151] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 15:10:19,502 INFO [Listener at localhost/36151] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/java.io.tmpdir/Jetty_localhost_39949_datanode____.8zklhd/webapp 2023-07-20 15:10:19,627 INFO [Listener at localhost/36151] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39949 2023-07-20 15:10:19,648 WARN [Listener at localhost/42797] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 15:10:19,702 WARN [Listener at localhost/42797] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-20 15:10:19,706 WARN [Listener at localhost/42797] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 15:10:19,708 INFO [Listener at localhost/42797] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 15:10:19,715 INFO [Listener at localhost/42797] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/java.io.tmpdir/Jetty_localhost_33845_datanode____.yvr0w0/webapp 2023-07-20 15:10:19,835 INFO [Listener at localhost/42797] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33845 2023-07-20 15:10:19,853 WARN [Listener at localhost/45801] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-20 15:10:20,118 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x13fc45de1c084341: Processing first storage report for DS-720c204a-6116-484d-9b08-7b548716dfff from datanode 78054dcf-83cb-412d-bfde-ea0072ff9ca4 2023-07-20 15:10:20,120 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x13fc45de1c084341: from storage DS-720c204a-6116-484d-9b08-7b548716dfff node DatanodeRegistration(127.0.0.1:37641, datanodeUuid=78054dcf-83cb-412d-bfde-ea0072ff9ca4, infoPort=33115, infoSecurePort=0, ipcPort=42797, storageInfo=lv=-57;cid=testClusterID;nsid=1087422564;c=1689865817332), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-20 15:10:20,121 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcacb9212c19d5b0f: Processing first storage report for DS-95d1652f-9351-44e7-8a08-650d97020b34 from datanode a1389188-ac9e-4b25-a960-b10a351d4208 2023-07-20 15:10:20,121 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcacb9212c19d5b0f: from storage DS-95d1652f-9351-44e7-8a08-650d97020b34 node DatanodeRegistration(127.0.0.1:34433, datanodeUuid=a1389188-ac9e-4b25-a960-b10a351d4208, infoPort=44945, infoSecurePort=0, ipcPort=36151, storageInfo=lv=-57;cid=testClusterID;nsid=1087422564;c=1689865817332), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 15:10:20,121 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x12196a46d14e3577: Processing first storage report for DS-e4d9b584-54a4-43d9-b048-1971eb3aa51e from datanode 9399af1c-ea3f-4303-b188-9245ac42f84f 2023-07-20 15:10:20,122 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x12196a46d14e3577: from storage DS-e4d9b584-54a4-43d9-b048-1971eb3aa51e node DatanodeRegistration(127.0.0.1:38235, datanodeUuid=9399af1c-ea3f-4303-b188-9245ac42f84f, infoPort=37809, infoSecurePort=0, ipcPort=45801, storageInfo=lv=-57;cid=testClusterID;nsid=1087422564;c=1689865817332), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-20 15:10:20,122 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x13fc45de1c084341: Processing first storage report for DS-aa75a91f-ac2b-4495-83c9-6f19f3b19f5c from datanode 78054dcf-83cb-412d-bfde-ea0072ff9ca4 2023-07-20 15:10:20,122 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x13fc45de1c084341: from storage DS-aa75a91f-ac2b-4495-83c9-6f19f3b19f5c node DatanodeRegistration(127.0.0.1:37641, datanodeUuid=78054dcf-83cb-412d-bfde-ea0072ff9ca4, infoPort=33115, infoSecurePort=0, ipcPort=42797, storageInfo=lv=-57;cid=testClusterID;nsid=1087422564;c=1689865817332), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 15:10:20,122 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xcacb9212c19d5b0f: Processing first storage report for DS-2de1f05c-2a2c-427c-9fcf-d0879bc6b070 from datanode a1389188-ac9e-4b25-a960-b10a351d4208 2023-07-20 15:10:20,122 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xcacb9212c19d5b0f: from storage DS-2de1f05c-2a2c-427c-9fcf-d0879bc6b070 node DatanodeRegistration(127.0.0.1:34433, datanodeUuid=a1389188-ac9e-4b25-a960-b10a351d4208, infoPort=44945, infoSecurePort=0, ipcPort=36151, storageInfo=lv=-57;cid=testClusterID;nsid=1087422564;c=1689865817332), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 15:10:20,123 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x12196a46d14e3577: Processing first storage report for DS-9d2f3af8-cf5c-4487-888c-d4fa5dfc0e8b from datanode 9399af1c-ea3f-4303-b188-9245ac42f84f 2023-07-20 15:10:20,123 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x12196a46d14e3577: from storage DS-9d2f3af8-cf5c-4487-888c-d4fa5dfc0e8b node DatanodeRegistration(127.0.0.1:38235, datanodeUuid=9399af1c-ea3f-4303-b188-9245ac42f84f, infoPort=37809, infoSecurePort=0, ipcPort=45801, storageInfo=lv=-57;cid=testClusterID;nsid=1087422564;c=1689865817332), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-20 15:10:20,349 DEBUG [Listener at localhost/45801] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d 2023-07-20 15:10:20,458 INFO [Listener at localhost/45801] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/cluster_360f6e79-b16a-b730-c2d8-9ed046e7a4b0/zookeeper_0, clientPort=60098, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/cluster_360f6e79-b16a-b730-c2d8-9ed046e7a4b0/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/cluster_360f6e79-b16a-b730-c2d8-9ed046e7a4b0/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-20 15:10:20,481 INFO [Listener at localhost/45801] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60098 2023-07-20 15:10:20,493 INFO [Listener at localhost/45801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:20,496 INFO [Listener at localhost/45801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:21,162 INFO [Listener at localhost/45801] util.FSUtils(471): Created version file at hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 with version=8 2023-07-20 15:10:21,162 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/hbase-staging 2023-07-20 15:10:21,532 INFO [Listener at localhost/45801] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-20 15:10:22,100 INFO [Listener at localhost/45801] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 15:10:22,137 INFO [Listener at localhost/45801] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,137 INFO [Listener at localhost/45801] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,138 INFO [Listener at localhost/45801] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 15:10:22,138 INFO [Listener at localhost/45801] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,138 INFO [Listener at localhost/45801] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 15:10:22,308 INFO [Listener at localhost/45801] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 15:10:22,408 DEBUG [Listener at localhost/45801] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-20 15:10:22,517 INFO [Listener at localhost/45801] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33245 2023-07-20 15:10:22,531 INFO [Listener at localhost/45801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,533 INFO [Listener at localhost/45801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,561 INFO [Listener at localhost/45801] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33245 connecting to ZooKeeper ensemble=127.0.0.1:60098 2023-07-20 15:10:22,620 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:332450x0, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 15:10:22,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33245-0x10183489c190000 connected 2023-07-20 15:10:22,660 DEBUG [Listener at localhost/45801] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 15:10:22,661 DEBUG [Listener at localhost/45801] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 15:10:22,676 DEBUG [Listener at localhost/45801] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 15:10:22,689 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33245 2023-07-20 15:10:22,689 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33245 2023-07-20 15:10:22,691 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33245 2023-07-20 15:10:22,692 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33245 2023-07-20 15:10:22,693 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33245 2023-07-20 15:10:22,701 INFO [Listener at localhost/45801] master.HMaster(444): hbase.rootdir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84, hbase.cluster.distributed=false 2023-07-20 15:10:22,788 INFO [Listener at localhost/45801] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 15:10:22,789 INFO [Listener at localhost/45801] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,789 INFO [Listener at localhost/45801] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,789 INFO [Listener at localhost/45801] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 15:10:22,789 INFO [Listener at localhost/45801] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,789 INFO [Listener at localhost/45801] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 15:10:22,794 INFO [Listener at localhost/45801] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 15:10:22,799 INFO [Listener at localhost/45801] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33243 2023-07-20 15:10:22,803 INFO [Listener at localhost/45801] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 15:10:22,814 DEBUG [Listener at localhost/45801] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-20 15:10:22,816 INFO [Listener at localhost/45801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,819 INFO [Listener at localhost/45801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,821 INFO [Listener at localhost/45801] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33243 connecting to ZooKeeper ensemble=127.0.0.1:60098 2023-07-20 15:10:22,830 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:332430x0, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 15:10:22,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33243-0x10183489c190001 connected 2023-07-20 15:10:22,831 DEBUG [Listener at localhost/45801] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 15:10:22,834 DEBUG [Listener at localhost/45801] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 15:10:22,835 DEBUG [Listener at localhost/45801] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 15:10:22,838 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33243 2023-07-20 15:10:22,839 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33243 2023-07-20 15:10:22,839 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33243 2023-07-20 15:10:22,843 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33243 2023-07-20 15:10:22,843 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33243 2023-07-20 15:10:22,858 INFO [Listener at localhost/45801] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 15:10:22,858 INFO [Listener at localhost/45801] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,858 INFO [Listener at localhost/45801] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,859 INFO [Listener at localhost/45801] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 15:10:22,859 INFO [Listener at localhost/45801] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,860 INFO [Listener at localhost/45801] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 15:10:22,860 INFO [Listener at localhost/45801] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 15:10:22,864 INFO [Listener at localhost/45801] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40765 2023-07-20 15:10:22,864 INFO [Listener at localhost/45801] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 15:10:22,872 DEBUG [Listener at localhost/45801] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-20 15:10:22,873 INFO [Listener at localhost/45801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,880 INFO [Listener at localhost/45801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,885 INFO [Listener at localhost/45801] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40765 connecting to ZooKeeper ensemble=127.0.0.1:60098 2023-07-20 15:10:22,892 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:407650x0, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 15:10:22,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40765-0x10183489c190002 connected 2023-07-20 15:10:22,893 DEBUG [Listener at localhost/45801] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 15:10:22,894 DEBUG [Listener at localhost/45801] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 15:10:22,895 DEBUG [Listener at localhost/45801] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 15:10:22,896 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40765 2023-07-20 15:10:22,897 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40765 2023-07-20 15:10:22,897 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40765 2023-07-20 15:10:22,898 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40765 2023-07-20 15:10:22,898 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40765 2023-07-20 15:10:22,912 INFO [Listener at localhost/45801] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-20 15:10:22,912 INFO [Listener at localhost/45801] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,912 INFO [Listener at localhost/45801] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,912 INFO [Listener at localhost/45801] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-20 15:10:22,912 INFO [Listener at localhost/45801] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-20 15:10:22,913 INFO [Listener at localhost/45801] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-20 15:10:22,913 INFO [Listener at localhost/45801] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-20 15:10:22,915 INFO [Listener at localhost/45801] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45307 2023-07-20 15:10:22,915 INFO [Listener at localhost/45801] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-20 15:10:22,920 DEBUG [Listener at localhost/45801] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-20 15:10:22,921 INFO [Listener at localhost/45801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,923 INFO [Listener at localhost/45801] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:22,925 INFO [Listener at localhost/45801] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45307 connecting to ZooKeeper ensemble=127.0.0.1:60098 2023-07-20 15:10:22,931 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:453070x0, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-20 15:10:22,932 DEBUG [Listener at localhost/45801] zookeeper.ZKUtil(164): regionserver:453070x0, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 15:10:22,932 DEBUG [Listener at localhost/45801] zookeeper.ZKUtil(164): regionserver:453070x0, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 15:10:22,933 DEBUG [Listener at localhost/45801] zookeeper.ZKUtil(164): regionserver:453070x0, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-20 15:10:22,940 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45307 2023-07-20 15:10:22,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45307-0x10183489c190003 connected 2023-07-20 15:10:22,941 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45307 2023-07-20 15:10:22,941 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45307 2023-07-20 15:10:22,943 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45307 2023-07-20 15:10:22,943 DEBUG [Listener at localhost/45801] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45307 2023-07-20 15:10:22,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33245,1689865821349 2023-07-20 15:10:22,964 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-20 15:10:22,966 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33245,1689865821349 2023-07-20 15:10:22,993 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 15:10:22,993 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 15:10:22,993 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 15:10:22,994 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-20 15:10:22,995 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:22,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-20 15:10:22,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33245,1689865821349 from backup master directory 2023-07-20 15:10:22,998 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-20 15:10:23,003 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33245,1689865821349 2023-07-20 15:10:23,003 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-20 15:10:23,004 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 15:10:23,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33245,1689865821349 2023-07-20 15:10:23,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-20 15:10:23,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-20 15:10:23,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/hbase.id with ID: 2cc557c8-1692-4819-b54b-41fe9e840193 2023-07-20 15:10:23,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-20 15:10:23,190 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:23,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1c10070b to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:23,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@649a6fb6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:23,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 15:10:23,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-20 15:10:23,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-20 15:10:23,374 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-20 15:10:23,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-20 15:10:23,384 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-20 15:10:23,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 15:10:23,437 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/MasterData/data/master/store-tmp 2023-07-20 15:10:23,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:23,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-20 15:10:23,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 15:10:23,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 15:10:23,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-20 15:10:23,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 15:10:23,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 15:10:23,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 15:10:23,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/MasterData/WALs/jenkins-hbase4.apache.org,33245,1689865821349 2023-07-20 15:10:23,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33245%2C1689865821349, suffix=, logDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/MasterData/WALs/jenkins-hbase4.apache.org,33245,1689865821349, archiveDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/MasterData/oldWALs, maxLogs=10 2023-07-20 15:10:23,657 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38235,DS-e4d9b584-54a4-43d9-b048-1971eb3aa51e,DISK] 2023-07-20 15:10:23,658 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37641,DS-720c204a-6116-484d-9b08-7b548716dfff,DISK] 2023-07-20 15:10:23,658 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34433,DS-95d1652f-9351-44e7-8a08-650d97020b34,DISK] 2023-07-20 15:10:23,669 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-20 15:10:23,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/MasterData/WALs/jenkins-hbase4.apache.org,33245,1689865821349/jenkins-hbase4.apache.org%2C33245%2C1689865821349.1689865823547 2023-07-20 15:10:23,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37641,DS-720c204a-6116-484d-9b08-7b548716dfff,DISK], DatanodeInfoWithStorage[127.0.0.1:34433,DS-95d1652f-9351-44e7-8a08-650d97020b34,DISK], DatanodeInfoWithStorage[127.0.0.1:38235,DS-e4d9b584-54a4-43d9-b048-1971eb3aa51e,DISK]] 2023-07-20 15:10:23,744 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-20 15:10:23,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:23,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 15:10:23,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 15:10:23,831 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-20 15:10:23,837 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-20 15:10:23,883 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-20 15:10:23,900 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:23,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-20 15:10:23,910 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-20 15:10:23,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-20 15:10:23,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:10:23,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60872294, jitterRate=-0.09293213486671448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:10:23,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 15:10:23,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-20 15:10:23,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-20 15:10:23,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-20 15:10:23,963 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-20 15:10:23,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-20 15:10:24,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 51 msec 2023-07-20 15:10:24,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-20 15:10:24,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-20 15:10:24,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-20 15:10:24,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-20 15:10:24,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-20 15:10:24,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-20 15:10:24,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-20 15:10:24,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-20 15:10:24,135 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:24,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-20 15:10:24,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-20 15:10:24,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-20 15:10:24,171 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 15:10:24,172 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 15:10:24,172 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 15:10:24,171 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-20 15:10:24,172 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:24,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33245,1689865821349, sessionid=0x10183489c190000, setting cluster-up flag (Was=false) 2023-07-20 15:10:24,200 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:24,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-20 15:10:24,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33245,1689865821349 2023-07-20 15:10:24,219 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:24,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-20 15:10:24,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33245,1689865821349 2023-07-20 15:10:24,237 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp 2023-07-20 15:10:24,251 INFO [RS:0;jenkins-hbase4:33243] regionserver.HRegionServer(951): ClusterId : 2cc557c8-1692-4819-b54b-41fe9e840193 2023-07-20 15:10:24,252 INFO [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(951): ClusterId : 2cc557c8-1692-4819-b54b-41fe9e840193 2023-07-20 15:10:24,263 INFO [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(951): ClusterId : 2cc557c8-1692-4819-b54b-41fe9e840193 2023-07-20 15:10:24,266 DEBUG [RS:0;jenkins-hbase4:33243] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 15:10:24,269 DEBUG [RS:1;jenkins-hbase4:40765] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 15:10:24,267 DEBUG [RS:2;jenkins-hbase4:45307] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-20 15:10:24,279 DEBUG [RS:1;jenkins-hbase4:40765] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 15:10:24,279 DEBUG [RS:1;jenkins-hbase4:40765] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 15:10:24,285 DEBUG [RS:2;jenkins-hbase4:45307] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 15:10:24,285 DEBUG [RS:2;jenkins-hbase4:45307] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 15:10:24,287 DEBUG [RS:0;jenkins-hbase4:33243] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-20 15:10:24,287 DEBUG [RS:0;jenkins-hbase4:33243] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-20 15:10:24,293 DEBUG [RS:1;jenkins-hbase4:40765] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 15:10:24,293 DEBUG [RS:2;jenkins-hbase4:45307] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 15:10:24,294 DEBUG [RS:0;jenkins-hbase4:33243] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-20 15:10:24,295 DEBUG [RS:1;jenkins-hbase4:40765] zookeeper.ReadOnlyZKClient(139): Connect 0x7d935042 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:24,315 DEBUG [RS:2;jenkins-hbase4:45307] zookeeper.ReadOnlyZKClient(139): Connect 0x65dbcfbe to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:24,316 DEBUG [RS:0;jenkins-hbase4:33243] zookeeper.ReadOnlyZKClient(139): Connect 0x29167771 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:24,364 DEBUG [RS:1;jenkins-hbase4:40765] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d01fcaa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:24,365 DEBUG [RS:1;jenkins-hbase4:40765] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7754b508, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 15:10:24,394 DEBUG [RS:2;jenkins-hbase4:45307] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20d94d61, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:24,394 DEBUG [RS:2;jenkins-hbase4:45307] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@522e9860, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 15:10:24,396 DEBUG [RS:0;jenkins-hbase4:33243] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7de83c8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:24,398 DEBUG [RS:0;jenkins-hbase4:33243] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5619a834, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 15:10:24,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-20 15:10:24,407 DEBUG [RS:2;jenkins-hbase4:45307] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:45307 2023-07-20 15:10:24,410 DEBUG [RS:0;jenkins-hbase4:33243] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33243 2023-07-20 15:10:24,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:24,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-20 15:10:24,413 INFO [RS:0;jenkins-hbase4:33243] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 15:10:24,413 INFO [RS:2;jenkins-hbase4:45307] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 15:10:24,414 INFO [RS:0;jenkins-hbase4:33243] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 15:10:24,414 INFO [RS:2;jenkins-hbase4:45307] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 15:10:24,414 DEBUG [RS:0;jenkins-hbase4:33243] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 15:10:24,414 DEBUG [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 15:10:24,415 INFO [RS:0;jenkins-hbase4:33243] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:24,415 INFO [RS:2;jenkins-hbase4:45307] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:24,415 DEBUG [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 15:10:24,415 DEBUG [RS:0;jenkins-hbase4:33243] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 15:10:24,419 DEBUG [RS:1;jenkins-hbase4:40765] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40765 2023-07-20 15:10:24,419 INFO [RS:0;jenkins-hbase4:33243] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33245,1689865821349 with isa=jenkins-hbase4.apache.org/172.31.14.131:33243, startcode=1689865822788 2023-07-20 15:10:24,419 INFO [RS:1;jenkins-hbase4:40765] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-20 15:10:24,419 INFO [RS:1;jenkins-hbase4:40765] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-20 15:10:24,419 INFO [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33245,1689865821349 with isa=jenkins-hbase4.apache.org/172.31.14.131:45307, startcode=1689865822911 2023-07-20 15:10:24,419 DEBUG [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-20 15:10:24,419 INFO [RS:1;jenkins-hbase4:40765] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:24,419 DEBUG [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(1022): About to register with Master. 2023-07-20 15:10:24,420 INFO [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33245,1689865821349 with isa=jenkins-hbase4.apache.org/172.31.14.131:40765, startcode=1689865822857 2023-07-20 15:10:24,440 DEBUG [RS:1;jenkins-hbase4:40765] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 15:10:24,440 DEBUG [RS:0;jenkins-hbase4:33243] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 15:10:24,440 DEBUG [RS:2;jenkins-hbase4:45307] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-20 15:10:24,520 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48901, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 15:10:24,521 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40261, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 15:10:24,521 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37277, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-20 15:10:24,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-20 15:10:24,538 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33245] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-20 15:10:24,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 15:10:24,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 15:10:24,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 15:10:24,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-20 15:10:24,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-20 15:10:24,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,547 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 15:10:24,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,549 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33245] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-20 15:10:24,551 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33245] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-20 15:10:24,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689865854584 2023-07-20 15:10:24,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-20 15:10:24,592 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-20 15:10:24,593 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-20 15:10:24,599 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 15:10:24,608 DEBUG [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(2830): Master is not running yet 2023-07-20 15:10:24,608 DEBUG [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(2830): Master is not running yet 2023-07-20 15:10:24,608 WARN [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-20 15:10:24,608 DEBUG [RS:0;jenkins-hbase4:33243] regionserver.HRegionServer(2830): Master is not running yet 2023-07-20 15:10:24,610 WARN [RS:0;jenkins-hbase4:33243] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-20 15:10:24,610 WARN [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-20 15:10:24,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-20 15:10:24,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-20 15:10:24,618 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-20 15:10:24,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-20 15:10:24,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-20 15:10:24,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-20 15:10:24,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-20 15:10:24,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-20 15:10:24,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-20 15:10:24,641 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-20 15:10:24,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689865824643,5,FailOnTimeoutGroup] 2023-07-20 15:10:24,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689865824644,5,FailOnTimeoutGroup] 2023-07-20 15:10:24,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,653 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-20 15:10:24,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,676 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-20 15:10:24,677 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-20 15:10:24,678 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:10:24,713 INFO [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33245,1689865821349 with isa=jenkins-hbase4.apache.org/172.31.14.131:45307, startcode=1689865822911 2023-07-20 15:10:24,713 INFO [RS:0;jenkins-hbase4:33243] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33245,1689865821349 with isa=jenkins-hbase4.apache.org/172.31.14.131:33243, startcode=1689865822788 2023-07-20 15:10:24,714 INFO [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33245,1689865821349 with isa=jenkins-hbase4.apache.org/172.31.14.131:40765, startcode=1689865822857 2023-07-20 15:10:24,724 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33245] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:24,730 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33245] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:24,731 DEBUG [RS:0;jenkins-hbase4:33243] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:10:24,731 DEBUG [RS:0;jenkins-hbase4:33243] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34279 2023-07-20 15:10:24,731 DEBUG [RS:0;jenkins-hbase4:33243] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 15:10:24,732 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33245] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:24,733 DEBUG [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:10:24,733 DEBUG [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34279 2023-07-20 15:10:24,733 DEBUG [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 15:10:24,735 DEBUG [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:10:24,735 DEBUG [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34279 2023-07-20 15:10:24,735 DEBUG [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-20 15:10:24,742 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 15:10:24,744 DEBUG [RS:1;jenkins-hbase4:40765] zookeeper.ZKUtil(162): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:24,745 DEBUG [RS:0;jenkins-hbase4:33243] zookeeper.ZKUtil(162): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:24,745 WARN [RS:1;jenkins-hbase4:40765] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 15:10:24,745 WARN [RS:0;jenkins-hbase4:33243] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 15:10:24,745 DEBUG [RS:2;jenkins-hbase4:45307] zookeeper.ZKUtil(162): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:24,745 WARN [RS:2;jenkins-hbase4:45307] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-20 15:10:24,745 INFO [RS:1;jenkins-hbase4:40765] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 15:10:24,746 INFO [RS:2;jenkins-hbase4:45307] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 15:10:24,748 DEBUG [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/WALs/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:24,748 DEBUG [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/WALs/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:24,745 INFO [RS:0;jenkins-hbase4:33243] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 15:10:24,748 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:24,748 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33243,1689865822788] 2023-07-20 15:10:24,748 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40765,1689865822857] 2023-07-20 15:10:24,749 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45307,1689865822911] 2023-07-20 15:10:24,748 DEBUG [RS:0;jenkins-hbase4:33243] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/WALs/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:24,753 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-20 15:10:24,759 DEBUG [RS:0;jenkins-hbase4:33243] zookeeper.ZKUtil(162): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:24,759 DEBUG [RS:1;jenkins-hbase4:40765] zookeeper.ZKUtil(162): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:24,759 DEBUG [RS:2;jenkins-hbase4:45307] zookeeper.ZKUtil(162): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:24,760 DEBUG [RS:0;jenkins-hbase4:33243] zookeeper.ZKUtil(162): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:24,760 DEBUG [RS:1;jenkins-hbase4:40765] zookeeper.ZKUtil(162): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:24,760 DEBUG [RS:2;jenkins-hbase4:45307] zookeeper.ZKUtil(162): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:24,761 DEBUG [RS:0;jenkins-hbase4:33243] zookeeper.ZKUtil(162): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:24,761 DEBUG [RS:2;jenkins-hbase4:45307] zookeeper.ZKUtil(162): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:24,761 DEBUG [RS:1;jenkins-hbase4:40765] zookeeper.ZKUtil(162): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:24,761 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/info 2023-07-20 15:10:24,762 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-20 15:10:24,763 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:24,763 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-20 15:10:24,766 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/rep_barrier 2023-07-20 15:10:24,767 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-20 15:10:24,768 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:24,768 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-20 15:10:24,773 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/table 2023-07-20 15:10:24,774 DEBUG [RS:0;jenkins-hbase4:33243] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 15:10:24,774 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-20 15:10:24,774 DEBUG [RS:1;jenkins-hbase4:40765] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 15:10:24,774 DEBUG [RS:2;jenkins-hbase4:45307] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-20 15:10:24,776 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:24,778 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740 2023-07-20 15:10:24,779 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740 2023-07-20 15:10:24,783 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-20 15:10:24,785 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-20 15:10:24,788 INFO [RS:2;jenkins-hbase4:45307] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 15:10:24,806 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:10:24,806 INFO [RS:0;jenkins-hbase4:33243] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 15:10:24,807 INFO [RS:1;jenkins-hbase4:40765] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-20 15:10:24,808 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71374492, jitterRate=0.06356281042098999}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-20 15:10:24,808 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-20 15:10:24,808 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-20 15:10:24,808 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-20 15:10:24,808 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-20 15:10:24,809 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-20 15:10:24,809 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-20 15:10:24,811 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-20 15:10:24,811 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-20 15:10:24,819 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-20 15:10:24,819 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-20 15:10:24,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-20 15:10:24,855 INFO [RS:0;jenkins-hbase4:33243] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 15:10:24,859 INFO [RS:1;jenkins-hbase4:40765] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 15:10:24,867 INFO [RS:2;jenkins-hbase4:45307] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-20 15:10:24,872 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-20 15:10:24,872 INFO [RS:1;jenkins-hbase4:40765] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 15:10:24,873 INFO [RS:1;jenkins-hbase4:40765] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,872 INFO [RS:2;jenkins-hbase4:45307] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 15:10:24,873 INFO [RS:2;jenkins-hbase4:45307] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,876 INFO [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 15:10:24,875 INFO [RS:0;jenkins-hbase4:33243] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-20 15:10:24,877 INFO [RS:0;jenkins-hbase4:33243] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,877 INFO [RS:0;jenkins-hbase4:33243] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 15:10:24,879 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-20 15:10:24,879 INFO [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-20 15:10:24,888 INFO [RS:0;jenkins-hbase4:33243] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,888 INFO [RS:1;jenkins-hbase4:40765] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,888 INFO [RS:2;jenkins-hbase4:45307] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,888 DEBUG [RS:0;jenkins-hbase4:33243] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,888 DEBUG [RS:1;jenkins-hbase4:40765] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,889 DEBUG [RS:0;jenkins-hbase4:33243] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,889 DEBUG [RS:1;jenkins-hbase4:40765] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,889 DEBUG [RS:2;jenkins-hbase4:45307] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,889 DEBUG [RS:1;jenkins-hbase4:40765] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,889 DEBUG [RS:2;jenkins-hbase4:45307] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,889 DEBUG [RS:1;jenkins-hbase4:40765] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,889 DEBUG [RS:2;jenkins-hbase4:45307] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,889 DEBUG [RS:1;jenkins-hbase4:40765] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,889 DEBUG [RS:2;jenkins-hbase4:45307] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,889 DEBUG [RS:1;jenkins-hbase4:40765] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 15:10:24,889 DEBUG [RS:2;jenkins-hbase4:45307] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,889 DEBUG [RS:1;jenkins-hbase4:40765] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,889 DEBUG [RS:0;jenkins-hbase4:33243] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,890 DEBUG [RS:1;jenkins-hbase4:40765] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,890 DEBUG [RS:2;jenkins-hbase4:45307] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 15:10:24,890 DEBUG [RS:1;jenkins-hbase4:40765] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,890 DEBUG [RS:0;jenkins-hbase4:33243] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,890 DEBUG [RS:1;jenkins-hbase4:40765] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,890 DEBUG [RS:2;jenkins-hbase4:45307] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,890 DEBUG [RS:0;jenkins-hbase4:33243] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,890 DEBUG [RS:2;jenkins-hbase4:45307] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,890 DEBUG [RS:0;jenkins-hbase4:33243] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-20 15:10:24,890 DEBUG [RS:2;jenkins-hbase4:45307] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,891 DEBUG [RS:0;jenkins-hbase4:33243] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,891 DEBUG [RS:2;jenkins-hbase4:45307] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,891 DEBUG [RS:0;jenkins-hbase4:33243] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,891 DEBUG [RS:0;jenkins-hbase4:33243] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,891 DEBUG [RS:0;jenkins-hbase4:33243] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-20 15:10:24,892 INFO [RS:1;jenkins-hbase4:40765] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,892 INFO [RS:1;jenkins-hbase4:40765] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,892 INFO [RS:1;jenkins-hbase4:40765] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,897 INFO [RS:2;jenkins-hbase4:45307] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,897 INFO [RS:0;jenkins-hbase4:33243] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,897 INFO [RS:2;jenkins-hbase4:45307] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,897 INFO [RS:0;jenkins-hbase4:33243] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,897 INFO [RS:0;jenkins-hbase4:33243] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,897 INFO [RS:2;jenkins-hbase4:45307] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,917 INFO [RS:0;jenkins-hbase4:33243] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 15:10:24,918 INFO [RS:2;jenkins-hbase4:45307] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 15:10:24,917 INFO [RS:1;jenkins-hbase4:40765] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-20 15:10:24,921 INFO [RS:0;jenkins-hbase4:33243] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33243,1689865822788-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,921 INFO [RS:2;jenkins-hbase4:45307] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45307,1689865822911-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,921 INFO [RS:1;jenkins-hbase4:40765] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40765,1689865822857-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:24,943 INFO [RS:0;jenkins-hbase4:33243] regionserver.Replication(203): jenkins-hbase4.apache.org,33243,1689865822788 started 2023-07-20 15:10:24,943 INFO [RS:0;jenkins-hbase4:33243] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33243,1689865822788, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33243, sessionid=0x10183489c190001 2023-07-20 15:10:24,943 INFO [RS:2;jenkins-hbase4:45307] regionserver.Replication(203): jenkins-hbase4.apache.org,45307,1689865822911 started 2023-07-20 15:10:24,944 INFO [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45307,1689865822911, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45307, sessionid=0x10183489c190003 2023-07-20 15:10:24,958 INFO [RS:1;jenkins-hbase4:40765] regionserver.Replication(203): jenkins-hbase4.apache.org,40765,1689865822857 started 2023-07-20 15:10:24,959 INFO [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40765,1689865822857, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40765, sessionid=0x10183489c190002 2023-07-20 15:10:24,959 DEBUG [RS:1;jenkins-hbase4:40765] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 15:10:24,959 DEBUG [RS:1;jenkins-hbase4:40765] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:24,959 DEBUG [RS:1;jenkins-hbase4:40765] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40765,1689865822857' 2023-07-20 15:10:24,959 DEBUG [RS:1;jenkins-hbase4:40765] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 15:10:24,960 DEBUG [RS:1;jenkins-hbase4:40765] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 15:10:24,964 DEBUG [RS:2;jenkins-hbase4:45307] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 15:10:24,964 DEBUG [RS:0;jenkins-hbase4:33243] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-20 15:10:24,964 DEBUG [RS:2;jenkins-hbase4:45307] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:24,964 DEBUG [RS:0;jenkins-hbase4:33243] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:24,965 DEBUG [RS:2;jenkins-hbase4:45307] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45307,1689865822911' 2023-07-20 15:10:24,966 DEBUG [RS:2;jenkins-hbase4:45307] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 15:10:24,965 DEBUG [RS:0;jenkins-hbase4:33243] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33243,1689865822788' 2023-07-20 15:10:24,967 DEBUG [RS:1;jenkins-hbase4:40765] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 15:10:24,967 DEBUG [RS:0;jenkins-hbase4:33243] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-20 15:10:24,967 DEBUG [RS:1;jenkins-hbase4:40765] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 15:10:24,967 DEBUG [RS:1;jenkins-hbase4:40765] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:24,967 DEBUG [RS:1;jenkins-hbase4:40765] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40765,1689865822857' 2023-07-20 15:10:24,967 DEBUG [RS:1;jenkins-hbase4:40765] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:24,968 DEBUG [RS:2;jenkins-hbase4:45307] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 15:10:24,968 DEBUG [RS:0;jenkins-hbase4:33243] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-20 15:10:24,969 DEBUG [RS:0;jenkins-hbase4:33243] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 15:10:24,969 DEBUG [RS:2;jenkins-hbase4:45307] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-20 15:10:24,969 DEBUG [RS:0;jenkins-hbase4:33243] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 15:10:24,969 DEBUG [RS:1;jenkins-hbase4:40765] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:24,969 DEBUG [RS:0;jenkins-hbase4:33243] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:24,969 DEBUG [RS:2;jenkins-hbase4:45307] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-20 15:10:24,970 DEBUG [RS:2;jenkins-hbase4:45307] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:24,970 DEBUG [RS:0;jenkins-hbase4:33243] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33243,1689865822788' 2023-07-20 15:10:24,970 DEBUG [RS:2;jenkins-hbase4:45307] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45307,1689865822911' 2023-07-20 15:10:24,970 DEBUG [RS:0;jenkins-hbase4:33243] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:24,970 DEBUG [RS:1;jenkins-hbase4:40765] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 15:10:24,970 DEBUG [RS:2;jenkins-hbase4:45307] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:24,970 INFO [RS:1;jenkins-hbase4:40765] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 15:10:24,970 INFO [RS:1;jenkins-hbase4:40765] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 15:10:24,971 DEBUG [RS:0;jenkins-hbase4:33243] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:24,971 DEBUG [RS:2;jenkins-hbase4:45307] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:24,975 DEBUG [RS:0;jenkins-hbase4:33243] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 15:10:24,975 DEBUG [RS:2;jenkins-hbase4:45307] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-20 15:10:24,975 INFO [RS:0;jenkins-hbase4:33243] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 15:10:24,975 INFO [RS:2;jenkins-hbase4:45307] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-20 15:10:24,976 INFO [RS:2;jenkins-hbase4:45307] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 15:10:24,976 INFO [RS:0;jenkins-hbase4:33243] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-20 15:10:25,031 DEBUG [jenkins-hbase4:33245] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-20 15:10:25,036 DEBUG [jenkins-hbase4:33245] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:10:25,043 DEBUG [jenkins-hbase4:33245] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:10:25,043 DEBUG [jenkins-hbase4:33245] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:10:25,043 DEBUG [jenkins-hbase4:33245] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:10:25,043 DEBUG [jenkins-hbase4:33245] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:10:25,046 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40765,1689865822857, state=OPENING 2023-07-20 15:10:25,054 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-20 15:10:25,055 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:25,056 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-20 15:10:25,061 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40765,1689865822857}] 2023-07-20 15:10:25,086 INFO [RS:2;jenkins-hbase4:45307] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45307%2C1689865822911, suffix=, logDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/WALs/jenkins-hbase4.apache.org,45307,1689865822911, archiveDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/oldWALs, maxLogs=32 2023-07-20 15:10:25,091 INFO [RS:1;jenkins-hbase4:40765] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40765%2C1689865822857, suffix=, logDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/WALs/jenkins-hbase4.apache.org,40765,1689865822857, archiveDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/oldWALs, maxLogs=32 2023-07-20 15:10:25,096 INFO [RS:0;jenkins-hbase4:33243] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33243%2C1689865822788, suffix=, logDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/WALs/jenkins-hbase4.apache.org,33243,1689865822788, archiveDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/oldWALs, maxLogs=32 2023-07-20 15:10:25,130 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38235,DS-e4d9b584-54a4-43d9-b048-1971eb3aa51e,DISK] 2023-07-20 15:10:25,174 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34433,DS-95d1652f-9351-44e7-8a08-650d97020b34,DISK] 2023-07-20 15:10:25,175 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38235,DS-e4d9b584-54a4-43d9-b048-1971eb3aa51e,DISK] 2023-07-20 15:10:25,175 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37641,DS-720c204a-6116-484d-9b08-7b548716dfff,DISK] 2023-07-20 15:10:25,175 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38235,DS-e4d9b584-54a4-43d9-b048-1971eb3aa51e,DISK] 2023-07-20 15:10:25,176 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37641,DS-720c204a-6116-484d-9b08-7b548716dfff,DISK] 2023-07-20 15:10:25,176 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34433,DS-95d1652f-9351-44e7-8a08-650d97020b34,DISK] 2023-07-20 15:10:25,176 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34433,DS-95d1652f-9351-44e7-8a08-650d97020b34,DISK] 2023-07-20 15:10:25,176 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37641,DS-720c204a-6116-484d-9b08-7b548716dfff,DISK] 2023-07-20 15:10:25,198 INFO [RS:2;jenkins-hbase4:45307] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/WALs/jenkins-hbase4.apache.org,45307,1689865822911/jenkins-hbase4.apache.org%2C45307%2C1689865822911.1689865825089 2023-07-20 15:10:25,202 DEBUG [RS:2;jenkins-hbase4:45307] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34433,DS-95d1652f-9351-44e7-8a08-650d97020b34,DISK], DatanodeInfoWithStorage[127.0.0.1:38235,DS-e4d9b584-54a4-43d9-b048-1971eb3aa51e,DISK], DatanodeInfoWithStorage[127.0.0.1:37641,DS-720c204a-6116-484d-9b08-7b548716dfff,DISK]] 2023-07-20 15:10:25,212 INFO [RS:0;jenkins-hbase4:33243] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/WALs/jenkins-hbase4.apache.org,33243,1689865822788/jenkins-hbase4.apache.org%2C33243%2C1689865822788.1689865825098 2023-07-20 15:10:25,212 INFO [RS:1;jenkins-hbase4:40765] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/WALs/jenkins-hbase4.apache.org,40765,1689865822857/jenkins-hbase4.apache.org%2C40765%2C1689865822857.1689865825095 2023-07-20 15:10:25,215 DEBUG [RS:0;jenkins-hbase4:33243] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38235,DS-e4d9b584-54a4-43d9-b048-1971eb3aa51e,DISK], DatanodeInfoWithStorage[127.0.0.1:37641,DS-720c204a-6116-484d-9b08-7b548716dfff,DISK], DatanodeInfoWithStorage[127.0.0.1:34433,DS-95d1652f-9351-44e7-8a08-650d97020b34,DISK]] 2023-07-20 15:10:25,216 DEBUG [RS:1;jenkins-hbase4:40765] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38235,DS-e4d9b584-54a4-43d9-b048-1971eb3aa51e,DISK], DatanodeInfoWithStorage[127.0.0.1:34433,DS-95d1652f-9351-44e7-8a08-650d97020b34,DISK], DatanodeInfoWithStorage[127.0.0.1:37641,DS-720c204a-6116-484d-9b08-7b548716dfff,DISK]] 2023-07-20 15:10:25,279 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:25,283 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 15:10:25,292 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 15:10:25,316 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-20 15:10:25,316 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-20 15:10:25,322 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40765%2C1689865822857.meta, suffix=.meta, logDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/WALs/jenkins-hbase4.apache.org,40765,1689865822857, archiveDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/oldWALs, maxLogs=32 2023-07-20 15:10:25,346 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37641,DS-720c204a-6116-484d-9b08-7b548716dfff,DISK] 2023-07-20 15:10:25,354 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38235,DS-e4d9b584-54a4-43d9-b048-1971eb3aa51e,DISK] 2023-07-20 15:10:25,359 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34433,DS-95d1652f-9351-44e7-8a08-650d97020b34,DISK] 2023-07-20 15:10:25,381 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/WALs/jenkins-hbase4.apache.org,40765,1689865822857/jenkins-hbase4.apache.org%2C40765%2C1689865822857.meta.1689865825323.meta 2023-07-20 15:10:25,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37641,DS-720c204a-6116-484d-9b08-7b548716dfff,DISK], DatanodeInfoWithStorage[127.0.0.1:34433,DS-95d1652f-9351-44e7-8a08-650d97020b34,DISK], DatanodeInfoWithStorage[127.0.0.1:38235,DS-e4d9b584-54a4-43d9-b048-1971eb3aa51e,DISK]] 2023-07-20 15:10:25,382 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-20 15:10:25,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-20 15:10:25,386 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:25,387 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-20 15:10:25,390 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-20 15:10:25,392 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-20 15:10:25,410 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-20 15:10:25,410 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:25,410 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-20 15:10:25,410 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-20 15:10:25,414 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-20 15:10:25,416 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/info 2023-07-20 15:10:25,418 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/info 2023-07-20 15:10:25,419 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-20 15:10:25,420 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:25,420 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-20 15:10:25,422 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/rep_barrier 2023-07-20 15:10:25,422 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/rep_barrier 2023-07-20 15:10:25,423 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-20 15:10:25,424 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:25,424 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-20 15:10:25,426 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/table 2023-07-20 15:10:25,426 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/table 2023-07-20 15:10:25,427 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-20 15:10:25,427 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:25,430 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740 2023-07-20 15:10:25,433 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740 2023-07-20 15:10:25,439 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-20 15:10:25,447 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-20 15:10:25,450 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72829321, jitterRate=0.08524145185947418}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-20 15:10:25,453 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-20 15:10:25,470 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689865825267 2023-07-20 15:10:25,497 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-20 15:10:25,498 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-20 15:10:25,499 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40765,1689865822857, state=OPEN 2023-07-20 15:10:25,508 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-20 15:10:25,508 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-20 15:10:25,519 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-20 15:10:25,519 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40765,1689865822857 in 447 msec 2023-07-20 15:10:25,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-20 15:10:25,527 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 681 msec 2023-07-20 15:10:25,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1100 sec 2023-07-20 15:10:25,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689865825535, completionTime=-1 2023-07-20 15:10:25,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-20 15:10:25,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-20 15:10:25,640 DEBUG [hconnection-0x5b8123ab-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:25,649 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:25,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-20 15:10:25,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689865885678 2023-07-20 15:10:25,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689865945678 2023-07-20 15:10:25,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 142 msec 2023-07-20 15:10:25,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33245,1689865821349-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:25,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33245,1689865821349-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:25,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33245,1689865821349-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:25,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33245, period=300000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:25,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-20 15:10:25,720 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-20 15:10:25,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-20 15:10:25,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 15:10:25,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-20 15:10:25,750 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:10:25,753 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:10:25,780 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/hbase/namespace/c194f842371b02bf37f277c52f634080 2023-07-20 15:10:25,783 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/hbase/namespace/c194f842371b02bf37f277c52f634080 empty. 2023-07-20 15:10:25,784 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/hbase/namespace/c194f842371b02bf37f277c52f634080 2023-07-20 15:10:25,784 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-20 15:10:25,838 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-20 15:10:25,842 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c194f842371b02bf37f277c52f634080, NAME => 'hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp 2023-07-20 15:10:25,899 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:25,899 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c194f842371b02bf37f277c52f634080, disabling compactions & flushes 2023-07-20 15:10:25,899 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080. 2023-07-20 15:10:25,899 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080. 2023-07-20 15:10:25,899 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080. after waiting 0 ms 2023-07-20 15:10:25,899 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080. 2023-07-20 15:10:25,900 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080. 2023-07-20 15:10:25,900 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c194f842371b02bf37f277c52f634080: 2023-07-20 15:10:25,906 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:10:25,926 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689865825911"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865825911"}]},"ts":"1689865825911"} 2023-07-20 15:10:25,955 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-20 15:10:25,958 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:10:25,963 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865825958"}]},"ts":"1689865825958"} 2023-07-20 15:10:25,969 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-20 15:10:25,975 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:10:25,976 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:10:25,977 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:10:25,977 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:10:25,977 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:10:25,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c194f842371b02bf37f277c52f634080, ASSIGN}] 2023-07-20 15:10:25,983 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c194f842371b02bf37f277c52f634080, ASSIGN 2023-07-20 15:10:25,985 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c194f842371b02bf37f277c52f634080, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45307,1689865822911; forceNewPlan=false, retain=false 2023-07-20 15:10:26,138 INFO [jenkins-hbase4:33245] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 15:10:26,140 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c194f842371b02bf37f277c52f634080, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:26,140 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689865826139"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865826139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865826139"}]},"ts":"1689865826139"} 2023-07-20 15:10:26,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c194f842371b02bf37f277c52f634080, server=jenkins-hbase4.apache.org,45307,1689865822911}] 2023-07-20 15:10:26,299 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:26,299 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 15:10:26,303 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46374, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 15:10:26,314 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080. 2023-07-20 15:10:26,315 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c194f842371b02bf37f277c52f634080, NAME => 'hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080.', STARTKEY => '', ENDKEY => ''} 2023-07-20 15:10:26,315 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080. service=AccessControlService 2023-07-20 15:10:26,316 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:26,317 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c194f842371b02bf37f277c52f634080 2023-07-20 15:10:26,317 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:26,317 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c194f842371b02bf37f277c52f634080 2023-07-20 15:10:26,317 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c194f842371b02bf37f277c52f634080 2023-07-20 15:10:26,321 INFO [StoreOpener-c194f842371b02bf37f277c52f634080-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c194f842371b02bf37f277c52f634080 2023-07-20 15:10:26,324 DEBUG [StoreOpener-c194f842371b02bf37f277c52f634080-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/namespace/c194f842371b02bf37f277c52f634080/info 2023-07-20 15:10:26,324 DEBUG [StoreOpener-c194f842371b02bf37f277c52f634080-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/namespace/c194f842371b02bf37f277c52f634080/info 2023-07-20 15:10:26,325 INFO [StoreOpener-c194f842371b02bf37f277c52f634080-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c194f842371b02bf37f277c52f634080 columnFamilyName info 2023-07-20 15:10:26,326 INFO [StoreOpener-c194f842371b02bf37f277c52f634080-1] regionserver.HStore(310): Store=c194f842371b02bf37f277c52f634080/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:26,336 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/namespace/c194f842371b02bf37f277c52f634080 2023-07-20 15:10:26,338 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/namespace/c194f842371b02bf37f277c52f634080 2023-07-20 15:10:26,346 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c194f842371b02bf37f277c52f634080 2023-07-20 15:10:26,353 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/namespace/c194f842371b02bf37f277c52f634080/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:10:26,354 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c194f842371b02bf37f277c52f634080; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65012713, jitterRate=-0.03123508393764496}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:10:26,354 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c194f842371b02bf37f277c52f634080: 2023-07-20 15:10:26,365 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080., pid=6, masterSystemTime=1689865826299 2023-07-20 15:10:26,372 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080. 2023-07-20 15:10:26,372 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080. 2023-07-20 15:10:26,379 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c194f842371b02bf37f277c52f634080, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:26,379 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689865826378"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865826378"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865826378"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865826378"}]},"ts":"1689865826378"} 2023-07-20 15:10:26,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-20 15:10:26,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c194f842371b02bf37f277c52f634080, server=jenkins-hbase4.apache.org,45307,1689865822911 in 240 msec 2023-07-20 15:10:26,402 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-20 15:10:26,403 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c194f842371b02bf37f277c52f634080, ASSIGN in 417 msec 2023-07-20 15:10:26,405 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:10:26,405 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865826405"}]},"ts":"1689865826405"} 2023-07-20 15:10:26,408 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-20 15:10:26,412 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:10:26,415 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 676 msec 2023-07-20 15:10:26,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-20 15:10:26,452 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-20 15:10:26,452 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:26,496 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:26,498 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:26,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-20 15:10:26,545 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-20 15:10:26,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 45 msec 2023-07-20 15:10:26,559 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-20 15:10:26,576 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-20 15:10:26,582 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 22 msec 2023-07-20 15:10:26,597 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-20 15:10:26,600 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-20 15:10:26,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.596sec 2023-07-20 15:10:26,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-20 15:10:26,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-20 15:10:26,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-20 15:10:26,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33245,1689865821349-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-20 15:10:26,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33245,1689865821349-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-20 15:10:26,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-20 15:10:26,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-20 15:10:26,637 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:10:26,639 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:10:26,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-20 15:10:26,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 15:10:26,649 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/hbase/acl/0b1fc22531f5aafdae2eda161f75d962 2023-07-20 15:10:26,651 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/hbase/acl/0b1fc22531f5aafdae2eda161f75d962 empty. 2023-07-20 15:10:26,654 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/hbase/acl/0b1fc22531f5aafdae2eda161f75d962 2023-07-20 15:10:26,654 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-20 15:10:26,686 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-20 15:10:26,687 DEBUG [Listener at localhost/45801] zookeeper.ReadOnlyZKClient(139): Connect 0x4d69ecc8 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:26,689 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0b1fc22531f5aafdae2eda161f75d962, NAME => 'hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp 2023-07-20 15:10:26,705 DEBUG [Listener at localhost/45801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76a534fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:26,732 DEBUG [hconnection-0x78d66f84-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:26,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 15:10:26,766 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:26,767 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:26,768 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 0b1fc22531f5aafdae2eda161f75d962, disabling compactions & flushes 2023-07-20 15:10:26,768 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962. 2023-07-20 15:10:26,768 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962. 2023-07-20 15:10:26,768 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962. after waiting 0 ms 2023-07-20 15:10:26,768 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962. 2023-07-20 15:10:26,768 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962. 2023-07-20 15:10:26,768 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 0b1fc22531f5aafdae2eda161f75d962: 2023-07-20 15:10:26,778 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33245,1689865821349 2023-07-20 15:10:26,778 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-20 15:10:26,779 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/test.cache.data in system properties and HBase conf 2023-07-20 15:10:26,779 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/hadoop.tmp.dir in system properties and HBase conf 2023-07-20 15:10:26,779 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/hadoop.log.dir in system properties and HBase conf 2023-07-20 15:10:26,779 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-20 15:10:26,779 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-20 15:10:26,779 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-20 15:10:26,780 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-20 15:10:26,780 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-20 15:10:26,780 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-20 15:10:26,780 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 15:10:26,780 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-20 15:10:26,780 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-20 15:10:26,781 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-20 15:10:26,781 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 15:10:26,781 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-20 15:10:26,781 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/nfs.dump.dir in system properties and HBase conf 2023-07-20 15:10:26,781 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/java.io.tmpdir in system properties and HBase conf 2023-07-20 15:10:26,781 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-20 15:10:26,781 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:10:26,781 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-20 15:10:26,782 INFO [Listener at localhost/45801] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-20 15:10:26,783 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689865826783"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865826783"}]},"ts":"1689865826783"} 2023-07-20 15:10:26,787 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-20 15:10:26,790 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:10:26,791 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865826791"}]},"ts":"1689865826791"} 2023-07-20 15:10:26,794 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-20 15:10:26,799 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:10:26,801 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:10:26,801 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:10:26,801 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:10:26,801 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:10:26,802 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=0b1fc22531f5aafdae2eda161f75d962, ASSIGN}] 2023-07-20 15:10:26,805 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=0b1fc22531f5aafdae2eda161f75d962, ASSIGN 2023-07-20 15:10:26,810 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=0b1fc22531f5aafdae2eda161f75d962, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40765,1689865822857; forceNewPlan=false, retain=false 2023-07-20 15:10:26,957 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 15:10:26,960 INFO [jenkins-hbase4:33245] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 15:10:26,969 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0b1fc22531f5aafdae2eda161f75d962, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:26,970 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689865826968"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865826968"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865826968"}]},"ts":"1689865826968"} 2023-07-20 15:10:26,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 0b1fc22531f5aafdae2eda161f75d962, server=jenkins-hbase4.apache.org,40765,1689865822857}] 2023-07-20 15:10:27,140 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962. 2023-07-20 15:10:27,141 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b1fc22531f5aafdae2eda161f75d962, NAME => 'hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962.', STARTKEY => '', ENDKEY => ''} 2023-07-20 15:10:27,141 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962. service=AccessControlService 2023-07-20 15:10:27,142 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:27,142 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 0b1fc22531f5aafdae2eda161f75d962 2023-07-20 15:10:27,142 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:27,142 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0b1fc22531f5aafdae2eda161f75d962 2023-07-20 15:10:27,142 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0b1fc22531f5aafdae2eda161f75d962 2023-07-20 15:10:27,144 INFO [StoreOpener-0b1fc22531f5aafdae2eda161f75d962-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 0b1fc22531f5aafdae2eda161f75d962 2023-07-20 15:10:27,147 DEBUG [StoreOpener-0b1fc22531f5aafdae2eda161f75d962-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/acl/0b1fc22531f5aafdae2eda161f75d962/l 2023-07-20 15:10:27,147 DEBUG [StoreOpener-0b1fc22531f5aafdae2eda161f75d962-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/acl/0b1fc22531f5aafdae2eda161f75d962/l 2023-07-20 15:10:27,148 INFO [StoreOpener-0b1fc22531f5aafdae2eda161f75d962-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b1fc22531f5aafdae2eda161f75d962 columnFamilyName l 2023-07-20 15:10:27,149 INFO [StoreOpener-0b1fc22531f5aafdae2eda161f75d962-1] regionserver.HStore(310): Store=0b1fc22531f5aafdae2eda161f75d962/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:27,151 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/acl/0b1fc22531f5aafdae2eda161f75d962 2023-07-20 15:10:27,152 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/acl/0b1fc22531f5aafdae2eda161f75d962 2023-07-20 15:10:27,157 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0b1fc22531f5aafdae2eda161f75d962 2023-07-20 15:10:27,161 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/acl/0b1fc22531f5aafdae2eda161f75d962/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:10:27,162 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0b1fc22531f5aafdae2eda161f75d962; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61910647, jitterRate=-0.07745946943759918}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:10:27,162 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0b1fc22531f5aafdae2eda161f75d962: 2023-07-20 15:10:27,164 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962., pid=11, masterSystemTime=1689865827133 2023-07-20 15:10:27,167 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962. 2023-07-20 15:10:27,167 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962. 2023-07-20 15:10:27,171 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0b1fc22531f5aafdae2eda161f75d962, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:27,171 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689865827171"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865827171"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865827171"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865827171"}]},"ts":"1689865827171"} 2023-07-20 15:10:27,180 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-20 15:10:27,180 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 0b1fc22531f5aafdae2eda161f75d962, server=jenkins-hbase4.apache.org,40765,1689865822857 in 201 msec 2023-07-20 15:10:27,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-20 15:10:27,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=0b1fc22531f5aafdae2eda161f75d962, ASSIGN in 379 msec 2023-07-20 15:10:27,185 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:10:27,186 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865827186"}]},"ts":"1689865827186"} 2023-07-20 15:10:27,188 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-20 15:10:27,201 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:10:27,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 569 msec 2023-07-20 15:10:27,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-20 15:10:27,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-20 15:10:27,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-20 15:10:28,032 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 15:10:28,355 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 15:10:28,363 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34459_jobhistory____.b0bnls/webapp 2023-07-20 15:10:28,532 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-20 15:10:28,532 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-20 15:10:28,532 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 15:10:28,535 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 15:10:28,617 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:29,001 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:29,366 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-20 15:10:29,419 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34459 2023-07-20 15:10:30,979 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 15:10:31,216 WARN [Listener at jenkins-hbase4.apache.org/34967] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 15:10:31,278 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-20 15:10:31,280 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-20 15:10:31,281 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-20 15:10:31,315 WARN [Listener at jenkins-hbase4.apache.org/34967] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 15:10:31,316 INFO [Listener at jenkins-hbase4.apache.org/34967] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 15:10:31,331 INFO [Listener at jenkins-hbase4.apache.org/34967] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36633_cluster____.4gx43z/webapp 2023-07-20 15:10:31,401 INFO [Listener at jenkins-hbase4.apache.org/34967] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 15:10:31,401 INFO [Listener at jenkins-hbase4.apache.org/34967] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-20 15:10:31,401 INFO [Listener at jenkins-hbase4.apache.org/34967] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 15:10:31,402 INFO [Listener at jenkins-hbase4.apache.org/34967] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 15:10:31,410 INFO [Listener at jenkins-hbase4.apache.org/34967] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:31,529 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:10:31,529 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-20 15:10:31,530 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:10:31,530 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-20 15:10:31,530 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-20 15:10:31,530 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-20 15:10:31,530 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:10:31,530 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-20 15:10:31,530 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-20 15:10:31,530 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-20 15:10:31,644 INFO [Listener at jenkins-hbase4.apache.org/34967] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:31,768 INFO [Listener at jenkins-hbase4.apache.org/34967] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:31,777 INFO [Listener at jenkins-hbase4.apache.org/34967] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36633 2023-07-20 15:10:32,228 WARN [Listener at jenkins-hbase4.apache.org/35779] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 15:10:32,251 WARN [Listener at jenkins-hbase4.apache.org/35779] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 15:10:32,251 INFO [Listener at jenkins-hbase4.apache.org/35779] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 15:10:32,256 INFO [Listener at jenkins-hbase4.apache.org/35779] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44507_node____.ibqngm/webapp 2023-07-20 15:10:32,315 INFO [Listener at jenkins-hbase4.apache.org/35779] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-20 15:10:32,315 INFO [Listener at jenkins-hbase4.apache.org/35779] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 15:10:32,316 INFO [Listener at jenkins-hbase4.apache.org/35779] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 15:10:32,316 INFO [Listener at jenkins-hbase4.apache.org/35779] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 15:10:32,327 INFO [Listener at jenkins-hbase4.apache.org/35779] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:32,352 INFO [Listener at jenkins-hbase4.apache.org/35779] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:32,441 INFO [Listener at jenkins-hbase4.apache.org/35779] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:32,458 INFO [Listener at jenkins-hbase4.apache.org/35779] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44507 2023-07-20 15:10:32,621 WARN [Listener at jenkins-hbase4.apache.org/37809] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-20 15:10:32,627 WARN [Listener at jenkins-hbase4.apache.org/37809] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-20 15:10:32,627 INFO [Listener at jenkins-hbase4.apache.org/37809] log.Slf4jLog(67): jetty-6.1.26 2023-07-20 15:10:32,633 INFO [Listener at jenkins-hbase4.apache.org/37809] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34915_node____.4s5hnq/webapp 2023-07-20 15:10:32,687 INFO [Listener at jenkins-hbase4.apache.org/37809] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-20 15:10:32,687 INFO [Listener at jenkins-hbase4.apache.org/37809] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-20 15:10:32,687 INFO [Listener at jenkins-hbase4.apache.org/37809] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-20 15:10:32,687 INFO [Listener at jenkins-hbase4.apache.org/37809] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-20 15:10:32,695 INFO [Listener at jenkins-hbase4.apache.org/37809] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:32,708 INFO [Listener at jenkins-hbase4.apache.org/37809] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:32,775 INFO [Listener at jenkins-hbase4.apache.org/37809] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-20 15:10:32,782 INFO [Listener at jenkins-hbase4.apache.org/37809] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34915 2023-07-20 15:10:32,808 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-20 15:10:32,810 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:10:32,894 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=265, ProcessCount=181, AvailableMemoryMB=5176 2023-07-20 15:10:32,894 WARN [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-20 15:10:32,911 DEBUG [Listener at jenkins-hbase4.apache.org/37809] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-20 15:10:32,920 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-20 15:10:32,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 15:10:32,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-20 15:10:32,935 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:10:32,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-20 15:10:32,937 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:10:32,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 15:10:32,942 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b 2023-07-20 15:10:32,943 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584 2023-07-20 15:10:32,945 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b empty. 2023-07-20 15:10:32,945 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584 empty. 2023-07-20 15:10:32,947 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b 2023-07-20 15:10:32,947 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584 2023-07-20 15:10:32,947 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-20 15:10:32,984 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-20 15:10:32,988 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => ae951278f6c6f3b22cefa70301c56584, NAME => 'testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp 2023-07-20 15:10:32,988 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1522395558931d54b7a56886581aa33b, NAME => 'testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp 2023-07-20 15:10:33,043 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:33,045 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing ae951278f6c6f3b22cefa70301c56584, disabling compactions & flushes 2023-07-20 15:10:33,045 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. 2023-07-20 15:10:33,045 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. 2023-07-20 15:10:33,045 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. after waiting 0 ms 2023-07-20 15:10:33,045 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. 2023-07-20 15:10:33,046 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. 2023-07-20 15:10:33,046 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for ae951278f6c6f3b22cefa70301c56584: 2023-07-20 15:10:33,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 15:10:33,047 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:33,047 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 1522395558931d54b7a56886581aa33b, disabling compactions & flushes 2023-07-20 15:10:33,047 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. 2023-07-20 15:10:33,047 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. 2023-07-20 15:10:33,047 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. after waiting 0 ms 2023-07-20 15:10:33,047 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. 2023-07-20 15:10:33,047 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. 2023-07-20 15:10:33,048 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 1522395558931d54b7a56886581aa33b: 2023-07-20 15:10:33,052 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:10:33,053 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865833053"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865833053"}]},"ts":"1689865833053"} 2023-07-20 15:10:33,053 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865833053"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865833053"}]},"ts":"1689865833053"} 2023-07-20 15:10:33,117 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 15:10:33,120 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:10:33,120 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865833120"}]},"ts":"1689865833120"} 2023-07-20 15:10:33,125 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-20 15:10:33,131 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:10:33,133 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:10:33,133 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:10:33,133 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:10:33,133 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:10:33,134 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1522395558931d54b7a56886581aa33b, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ae951278f6c6f3b22cefa70301c56584, ASSIGN}] 2023-07-20 15:10:33,137 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ae951278f6c6f3b22cefa70301c56584, ASSIGN 2023-07-20 15:10:33,137 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1522395558931d54b7a56886581aa33b, ASSIGN 2023-07-20 15:10:33,138 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ae951278f6c6f3b22cefa70301c56584, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33243,1689865822788; forceNewPlan=false, retain=false 2023-07-20 15:10:33,138 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1522395558931d54b7a56886581aa33b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40765,1689865822857; forceNewPlan=false, retain=false 2023-07-20 15:10:33,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 15:10:33,289 INFO [jenkins-hbase4:33245] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 15:10:33,292 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=1522395558931d54b7a56886581aa33b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:33,292 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ae951278f6c6f3b22cefa70301c56584, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:33,292 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865833291"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865833291"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865833291"}]},"ts":"1689865833291"} 2023-07-20 15:10:33,292 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865833292"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865833292"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865833292"}]},"ts":"1689865833292"} 2023-07-20 15:10:33,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 1522395558931d54b7a56886581aa33b, server=jenkins-hbase4.apache.org,40765,1689865822857}] 2023-07-20 15:10:33,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure ae951278f6c6f3b22cefa70301c56584, server=jenkins-hbase4.apache.org,33243,1689865822788}] 2023-07-20 15:10:33,451 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:33,452 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 15:10:33,455 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 15:10:33,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. 2023-07-20 15:10:33,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1522395558931d54b7a56886581aa33b, NAME => 'testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 15:10:33,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. service=AccessControlService 2023-07-20 15:10:33,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:33,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 1522395558931d54b7a56886581aa33b 2023-07-20 15:10:33,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:33,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1522395558931d54b7a56886581aa33b 2023-07-20 15:10:33,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1522395558931d54b7a56886581aa33b 2023-07-20 15:10:33,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. 2023-07-20 15:10:33,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ae951278f6c6f3b22cefa70301c56584, NAME => 'testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 15:10:33,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. service=AccessControlService 2023-07-20 15:10:33,460 INFO [StoreOpener-1522395558931d54b7a56886581aa33b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1522395558931d54b7a56886581aa33b 2023-07-20 15:10:33,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:33,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName ae951278f6c6f3b22cefa70301c56584 2023-07-20 15:10:33,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:33,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ae951278f6c6f3b22cefa70301c56584 2023-07-20 15:10:33,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ae951278f6c6f3b22cefa70301c56584 2023-07-20 15:10:33,464 DEBUG [StoreOpener-1522395558931d54b7a56886581aa33b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b/cf 2023-07-20 15:10:33,464 DEBUG [StoreOpener-1522395558931d54b7a56886581aa33b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b/cf 2023-07-20 15:10:33,464 INFO [StoreOpener-1522395558931d54b7a56886581aa33b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1522395558931d54b7a56886581aa33b columnFamilyName cf 2023-07-20 15:10:33,465 INFO [StoreOpener-1522395558931d54b7a56886581aa33b-1] regionserver.HStore(310): Store=1522395558931d54b7a56886581aa33b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:33,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b 2023-07-20 15:10:33,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b 2023-07-20 15:10:33,473 INFO [StoreOpener-ae951278f6c6f3b22cefa70301c56584-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ae951278f6c6f3b22cefa70301c56584 2023-07-20 15:10:33,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1522395558931d54b7a56886581aa33b 2023-07-20 15:10:33,475 DEBUG [StoreOpener-ae951278f6c6f3b22cefa70301c56584-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584/cf 2023-07-20 15:10:33,476 DEBUG [StoreOpener-ae951278f6c6f3b22cefa70301c56584-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584/cf 2023-07-20 15:10:33,476 INFO [StoreOpener-ae951278f6c6f3b22cefa70301c56584-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae951278f6c6f3b22cefa70301c56584 columnFamilyName cf 2023-07-20 15:10:33,477 INFO [StoreOpener-ae951278f6c6f3b22cefa70301c56584-1] regionserver.HStore(310): Store=ae951278f6c6f3b22cefa70301c56584/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:33,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:10:33,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584 2023-07-20 15:10:33,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1522395558931d54b7a56886581aa33b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67552726, jitterRate=0.006614059209823608}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:10:33,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1522395558931d54b7a56886581aa33b: 2023-07-20 15:10:33,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584 2023-07-20 15:10:33,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b., pid=15, masterSystemTime=1689865833448 2023-07-20 15:10:33,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. 2023-07-20 15:10:33,490 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. 2023-07-20 15:10:33,491 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=1522395558931d54b7a56886581aa33b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:33,492 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865833491"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865833491"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865833491"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865833491"}]},"ts":"1689865833491"} 2023-07-20 15:10:33,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ae951278f6c6f3b22cefa70301c56584 2023-07-20 15:10:33,500 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-20 15:10:33,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 1522395558931d54b7a56886581aa33b, server=jenkins-hbase4.apache.org,40765,1689865822857 in 200 msec 2023-07-20 15:10:33,505 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1522395558931d54b7a56886581aa33b, ASSIGN in 368 msec 2023-07-20 15:10:33,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:10:33,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ae951278f6c6f3b22cefa70301c56584; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64802120, jitterRate=-0.03437316417694092}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:10:33,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ae951278f6c6f3b22cefa70301c56584: 2023-07-20 15:10:33,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584., pid=16, masterSystemTime=1689865833451 2023-07-20 15:10:33,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. 2023-07-20 15:10:33,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. 2023-07-20 15:10:33,525 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=ae951278f6c6f3b22cefa70301c56584, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:33,525 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865833525"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865833525"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865833525"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865833525"}]},"ts":"1689865833525"} 2023-07-20 15:10:33,532 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-20 15:10:33,532 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure ae951278f6c6f3b22cefa70301c56584, server=jenkins-hbase4.apache.org,33243,1689865822788 in 231 msec 2023-07-20 15:10:33,536 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-20 15:10:33,539 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ae951278f6c6f3b22cefa70301c56584, ASSIGN in 398 msec 2023-07-20 15:10:33,540 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:10:33,542 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865833541"}]},"ts":"1689865833541"} 2023-07-20 15:10:33,544 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-20 15:10:33,547 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:10:33,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 15:10:33,553 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-20 15:10:33,574 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40765] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 15:10:33,625 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:33,625 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:33,625 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:33,625 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:33,626 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:10:33,634 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 15:10:33,634 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 15:10:33,634 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 15:10:33,634 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-20 15:10:33,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 707 msec 2023-07-20 15:10:34,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-20 15:10:34,053 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-20 15:10:34,053 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-20 15:10:34,054 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:10:34,059 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-20 15:10:34,060 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:10:34,060 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-20 15:10:34,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 15:10:34,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865834075 (current time:1689865834075). 2023-07-20 15:10:34,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:10:34,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x5358173b to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:34,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39abfd19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:34,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:34,087 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:34,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5358173b to 127.0.0.1:60098 2023-07-20 15:10:34,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:10:34,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x6c8810ab to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:34,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@321bafed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:34,098 DEBUG [hconnection-0x212acd8a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:34,101 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:34,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c8810ab to 127.0.0.1:60098 2023-07-20 15:10:34,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:10:34,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 15:10:34,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:10:34,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 15:10:34,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 15:10:34,153 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 15:10:34,155 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689866434154 2023-07-20 15:10:34,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 15:10:34,157 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-20 15:10:34,165 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 15:10:34,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 15:10:34,167 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:10:34,167 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:10:34,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 22 msec 2023-07-20 15:10:34,170 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 15:10:34,171 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689866434171 2023-07-20 15:10:34,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,205 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-20 15:10:34,205 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:34,206 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-20 15:10:34,206 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-20 15:10:34,207 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,207 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,214 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,214 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,214 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,214 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,215 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,215 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,215 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,216 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:10:34,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 15:10:34,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 15:10:34,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-20 15:10:34,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,217 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 15:10:34,217 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 15:10:34,217 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 15:10:34,220 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,220 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,220 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,220 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 15:10:34,220 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 15:10:34,220 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 15:10:34,220 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:34,220 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:34,222 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 15:10:34,220 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:34,223 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 15:10:34,223 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 15:10:34,224 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 15:10:34,224 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 15:10:34,224 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 15:10:34,224 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 15:10:34,224 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-20 15:10:34,224 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-20 15:10:34,226 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,227 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,227 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:34,227 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,228 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,228 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:34,228 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:34,228 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:34,228 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:34,228 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,228 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:34,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:34,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-20 15:10:34,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53febab3[Count = 1] remaining members to acquire global barrier 2023-07-20 15:10:34,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:34,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:34,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:34,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:34,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:34,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-20 15:10:34,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53febab3[Count = 0] remaining members to acquire global barrier 2023-07-20 15:10:34,233 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-20 15:10:34,233 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,237 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,237 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,237 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,237 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,237 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 15:10:34,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,237 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 15:10:34,237 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 15:10:34,238 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,238 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:10:34,237 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 15:10:34,237 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45307,1689865822911' in zk 2023-07-20 15:10:34,240 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:10:34,240 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. 2023-07-20 15:10:34,240 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:10:34,240 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. started... 2023-07-20 15:10:34,243 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:10:34,243 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:10:34,243 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. 2023-07-20 15:10:34,243 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. started... 2023-07-20 15:10:34,243 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 15:10:34,243 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:34,243 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 15:10:34,245 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ae951278f6c6f3b22cefa70301c56584: 2023-07-20 15:10:34,245 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1522395558931d54b7a56886581aa33b: 2023-07-20 15:10:34,246 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,246 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,252 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:10:34,252 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:10:34,256 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:10:34,256 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:10:34,267 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:34,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 15:10:34,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:10:34,285 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:10:34,298 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. completed. 2023-07-20 15:10:34,298 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. 2023-07-20 15:10:34,298 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:10:34,298 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:10:34,298 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,299 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 15:10:34,299 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33243,1689865822788' in zk 2023-07-20 15:10:34,300 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. completed. 2023-07-20 15:10:34,301 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. 2023-07-20 15:10:34,301 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:10:34,301 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:10:34,301 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,301 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-20 15:10:34,301 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40765,1689865822857' in zk 2023-07-20 15:10:34,301 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,301 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 15:10:34,301 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:34,302 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 15:10:34,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:34,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:34,304 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 15:10:34,304 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:34,304 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:34,305 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-20 15:10:34,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:34,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:34,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33243,1689865822788': 2023-07-20 15:10:34,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-20 15:10:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:34,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:34,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:34,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40765,1689865822857': 2023-07-20 15:10:34,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-20 15:10:34,321 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-20 15:10:34,321 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:10:34,321 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:10:34,321 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,322 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:10:34,327 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,327 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,327 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:34,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,327 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,327 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,327 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,328 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:34,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,328 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,329 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:34,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,329 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:34,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,332 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,333 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,333 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,348 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,348 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,348 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,348 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,348 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,348 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,348 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,348 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,348 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,349 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,348 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:34,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,349 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,350 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,350 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,350 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,350 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,350 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,351 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,351 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,485 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:34,486 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-20 15:10:34,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 15:10:34,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:10:34,488 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:34,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689865834157Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689865834349 (+192 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689865834349Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689865834371 (+22 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689865834399 (+28 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689865834486 (+87 ms) 2023-07-20 15:10:34,496 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 15:10:34,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 337 msec 2023-07-20 15:10:34,523 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:34,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40765] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:10:34,533 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:34,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33243] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:10:34,546 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-20 15:10:34,551 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. 2023-07-20 15:10:34,554 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:10:34,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 15:10:34,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865834590 (current time:1689865834590). 2023-07-20 15:10:34,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:10:34,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x20ea5d94 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:34,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79eddade, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:34,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:34,601 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:34,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20ea5d94 to 127.0.0.1:60098 2023-07-20 15:10:34,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:10:34,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x506b15dd to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:34,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@229ff4b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:34,611 DEBUG [hconnection-0x35b3e11e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:34,614 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:34,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x506b15dd to 127.0.0.1:60098 2023-07-20 15:10:34,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:10:34,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-20 15:10:34,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:10:34,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 15:10:34,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 15:10:34,625 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 15:10:34,628 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689866434628 2023-07-20 15:10:34,628 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-20 15:10:34,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-20 15:10:34,630 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:10:34,630 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:10:34,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 15:10:34,631 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-20 15:10:34,633 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 9 msec 2023-07-20 15:10:34,634 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 15:10:34,635 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689866434635 2023-07-20 15:10:34,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-20 15:10:34,654 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-20 15:10:34,654 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:34,656 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-20 15:10:34,656 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-20 15:10:34,656 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,657 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,659 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,659 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,659 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,660 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,661 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,661 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 15:10:34,662 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,662 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:10:34,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,663 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 15:10:34,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 15:10:34,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,664 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 15:10:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-20 15:10:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,664 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-20 15:10:34,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 15:10:34,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 15:10:34,664 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 15:10:34,665 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:34,665 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 15:10:34,665 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-20 15:10:34,666 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 15:10:34,666 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-20 15:10:34,667 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:34,665 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:34,668 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 15:10:34,666 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 15:10:34,669 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 15:10:34,669 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-20 15:10:34,669 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 15:10:34,669 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 15:10:34,669 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-20 15:10:34,670 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-20 15:10:34,672 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,672 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:34,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:34,674 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,674 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:34,674 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,674 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:34,674 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,675 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:34,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:34,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,677 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:34,679 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,679 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:34,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-20 15:10:34,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c445432[Count = 1] remaining members to acquire global barrier 2023-07-20 15:10:34,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:34,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:34,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:34,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:34,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:34,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-20 15:10:34,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c445432[Count = 0] remaining members to acquire global barrier 2023-07-20 15:10:34,684 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-20 15:10:34,684 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,689 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,689 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,689 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,689 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 15:10:34,689 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,689 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 15:10:34,689 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-20 15:10:34,689 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:10:34,690 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,690 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:10:34,690 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:10:34,690 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:10:34,690 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. 2023-07-20 15:10:34,690 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. 2023-07-20 15:10:34,689 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 15:10:34,690 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. started... 2023-07-20 15:10:34,690 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45307,1689865822911' in zk 2023-07-20 15:10:34,690 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. started... 2023-07-20 15:10:34,690 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:10:34,690 INFO [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1522395558931d54b7a56886581aa33b 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-20 15:10:34,690 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ae951278f6c6f3b22cefa70301c56584 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-20 15:10:34,693 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 15:10:34,693 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:34,693 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 15:10:34,730 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:34,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 15:10:34,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:10:34,733 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:10:34,811 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584/.tmp/cf/d03e359963764e6fb4a8f927ca556bd5 2023-07-20 15:10:34,811 INFO [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b/.tmp/cf/08a8b3a31b2f4ab5b9d030bcae7a0c0b 2023-07-20 15:10:34,870 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584/.tmp/cf/d03e359963764e6fb4a8f927ca556bd5 as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584/cf/d03e359963764e6fb4a8f927ca556bd5 2023-07-20 15:10:34,870 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b/.tmp/cf/08a8b3a31b2f4ab5b9d030bcae7a0c0b as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b/cf/08a8b3a31b2f4ab5b9d030bcae7a0c0b 2023-07-20 15:10:34,882 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584/cf/d03e359963764e6fb4a8f927ca556bd5, entries=45, sequenceid=6, filesize=7.9 K 2023-07-20 15:10:34,885 INFO [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b/cf/08a8b3a31b2f4ab5b9d030bcae7a0c0b, entries=5, sequenceid=6, filesize=5.2 K 2023-07-20 15:10:34,891 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for ae951278f6c6f3b22cefa70301c56584 in 201ms, sequenceid=6, compaction requested=false 2023-07-20 15:10:34,891 INFO [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 1522395558931d54b7a56886581aa33b in 201ms, sequenceid=6, compaction requested=false 2023-07-20 15:10:34,891 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-20 15:10:34,892 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-20 15:10:34,893 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ae951278f6c6f3b22cefa70301c56584: 2023-07-20 15:10:34,894 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 15:10:34,894 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:10:34,894 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584/cf/d03e359963764e6fb4a8f927ca556bd5] hfiles 2023-07-20 15:10:34,894 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584/cf/d03e359963764e6fb4a8f927ca556bd5 for snapshot=snaptb0-testExportWithTargetName 2023-07-20 15:10:34,895 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1522395558931d54b7a56886581aa33b: 2023-07-20 15:10:34,896 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-20 15:10:34,896 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:10:34,896 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b/cf/08a8b3a31b2f4ab5b9d030bcae7a0c0b] hfiles 2023-07-20 15:10:34,896 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b/cf/08a8b3a31b2f4ab5b9d030bcae7a0c0b for snapshot=snaptb0-testExportWithTargetName 2023-07-20 15:10:34,933 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:34,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 15:10:34,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:10:34,936 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 15:10:34,947 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. completed. 2023-07-20 15:10:34,947 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. 2023-07-20 15:10:34,947 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:10:34,947 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:10:34,947 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,948 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 15:10:34,948 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40765,1689865822857' in zk 2023-07-20 15:10:34,948 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. completed. 2023-07-20 15:10:34,948 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. 2023-07-20 15:10:34,948 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:10:34,948 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:10:34,948 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,948 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-20 15:10:34,948 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33243,1689865822788' in zk 2023-07-20 15:10:34,950 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 15:10:34,950 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:34,951 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 15:10:34,951 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:34,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:34,952 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-20 15:10:34,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:34,953 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:34,953 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,953 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-20 15:10:34,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:34,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:34,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40765,1689865822857': 2023-07-20 15:10:34,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-20 15:10:34,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:34,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:34,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:34,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:34,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:34,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33243,1689865822788': 2023-07-20 15:10:34,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-20 15:10:34,962 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-20 15:10:34,962 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:10:34,962 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:10:34,962 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-20 15:10:34,962 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:10:34,970 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,970 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:34,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:34,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,970 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,970 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,970 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,970 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,970 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:34,971 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,972 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:34,972 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:34,975 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-20 15:10:34,976 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,976 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,989 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,989 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,989 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,989 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,989 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,989 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,989 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:34,989 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,989 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:34,989 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:34,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,989 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-20 15:10:34,989 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:34,989 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,991 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,991 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:34,989 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,991 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:34,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:34,990 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-20 15:10:34,995 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:34,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 15:10:34,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:34,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:34,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:35,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-20 15:10:35,154 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-20 15:10:35,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 15:10:35,155 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-20 15:10:35,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689865834628Consolidate snapshot: snaptb0-testExportWithTargetName at 1689865834990 (+362 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689865834995 (+5 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689865835004 (+9 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689865835043 (+39 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689865835154 (+111 ms) 2023-07-20 15:10:35,157 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-20 15:10:35,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 528 msec 2023-07-20 15:10:35,236 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:35,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-20 15:10:35,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:10:35,239 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865835239 2023-07-20 15:10:35,239 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34279, tgtDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865835239, rawTgtDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865835239, srcFsUri=hdfs://localhost:34279, srcDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:10:35,281 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34279, inputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:10:35,281 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1352038461_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865835239, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865835239/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-20 15:10:35,281 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34279, inputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84, snapshotDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-20 15:10:35,301 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865835239/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-20 15:10:35,401 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,401 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,402 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,403 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,403 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,404 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,405 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,488 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/hadoop-2639402964733879044.jar 2023-07-20 15:10:35,489 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,489 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,490 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,490 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,491 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,491 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:35,492 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 15:10:35,493 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 15:10:35,493 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 15:10:35,494 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 15:10:35,494 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 15:10:35,495 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 15:10:35,496 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 15:10:35,496 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 15:10:35,497 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 15:10:35,497 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 15:10:35,501 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:10:35,502 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:10:35,502 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:10:35,502 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:10:35,503 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:10:35,504 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:10:35,504 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:10:36,613 WARN [Listener at jenkins-hbase4.apache.org/37809] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 15:10:36,619 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-20 15:10:36,628 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-20 15:10:37,167 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:10:37,169 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:10:37,737 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0001_000001 (auth:SIMPLE) 2023-07-20 15:10:38,992 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 15:10:43,073 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0001_000001 (auth:SIMPLE) 2023-07-20 15:10:45,349 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0001_000001 (auth:SIMPLE) 2023-07-20 15:10:48,431 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0001_000001 (auth:SIMPLE) 2023-07-20 15:10:49,553 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 15:10:49,556 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 15:10:49,564 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-20 15:10:49,564 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 15:10:49,565 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 15:10:49,565 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-201645114_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-20 15:10:49,566 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-20 15:10:49,566 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-20 15:10:49,566 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-201645114_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865835239/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865835239/.hbase-snapshot/testExportWithTargetName 2023-07-20 15:10:49,566 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865835239/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-20 15:10:49,567 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865835239/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-20 15:10:49,576 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-20 15:10:49,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-20 15:10:49,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-20 15:10:49,593 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865849593"}]},"ts":"1689865849593"} 2023-07-20 15:10:49,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 15:10:49,595 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-20 15:10:49,596 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-20 15:10:49,598 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1522395558931d54b7a56886581aa33b, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ae951278f6c6f3b22cefa70301c56584, UNASSIGN}] 2023-07-20 15:10:49,600 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1522395558931d54b7a56886581aa33b, UNASSIGN 2023-07-20 15:10:49,600 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ae951278f6c6f3b22cefa70301c56584, UNASSIGN 2023-07-20 15:10:49,601 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=1522395558931d54b7a56886581aa33b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:49,601 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=ae951278f6c6f3b22cefa70301c56584, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:49,601 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865849601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865849601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865849601"}]},"ts":"1689865849601"} 2023-07-20 15:10:49,602 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865849601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865849601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865849601"}]},"ts":"1689865849601"} 2023-07-20 15:10:49,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 1522395558931d54b7a56886581aa33b, server=jenkins-hbase4.apache.org,40765,1689865822857}] 2023-07-20 15:10:49,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure ae951278f6c6f3b22cefa70301c56584, server=jenkins-hbase4.apache.org,33243,1689865822788}] 2023-07-20 15:10:49,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 15:10:49,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1522395558931d54b7a56886581aa33b 2023-07-20 15:10:49,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ae951278f6c6f3b22cefa70301c56584 2023-07-20 15:10:49,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1522395558931d54b7a56886581aa33b, disabling compactions & flushes 2023-07-20 15:10:49,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ae951278f6c6f3b22cefa70301c56584, disabling compactions & flushes 2023-07-20 15:10:49,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. 2023-07-20 15:10:49,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. 2023-07-20 15:10:49,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. 2023-07-20 15:10:49,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. 2023-07-20 15:10:49,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. after waiting 0 ms 2023-07-20 15:10:49,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. after waiting 0 ms 2023-07-20 15:10:49,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. 2023-07-20 15:10:49,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. 2023-07-20 15:10:49,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:10:49,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:10:49,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:10:49,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:10:49,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584. 2023-07-20 15:10:49,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ae951278f6c6f3b22cefa70301c56584: 2023-07-20 15:10:49,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b. 2023-07-20 15:10:49,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1522395558931d54b7a56886581aa33b: 2023-07-20 15:10:49,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ae951278f6c6f3b22cefa70301c56584 2023-07-20 15:10:49,784 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=ae951278f6c6f3b22cefa70301c56584, regionState=CLOSED 2023-07-20 15:10:49,785 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865849784"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865849784"}]},"ts":"1689865849784"} 2023-07-20 15:10:49,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1522395558931d54b7a56886581aa33b 2023-07-20 15:10:49,785 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=1522395558931d54b7a56886581aa33b, regionState=CLOSED 2023-07-20 15:10:49,786 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689865849785"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865849785"}]},"ts":"1689865849785"} 2023-07-20 15:10:49,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-20 15:10:49,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure ae951278f6c6f3b22cefa70301c56584, server=jenkins-hbase4.apache.org,33243,1689865822788 in 182 msec 2023-07-20 15:10:49,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-20 15:10:49,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 1522395558931d54b7a56886581aa33b, server=jenkins-hbase4.apache.org,40765,1689865822857 in 184 msec 2023-07-20 15:10:49,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ae951278f6c6f3b22cefa70301c56584, UNASSIGN in 191 msec 2023-07-20 15:10:49,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-20 15:10:49,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1522395558931d54b7a56886581aa33b, UNASSIGN in 193 msec 2023-07-20 15:10:49,794 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865849794"}]},"ts":"1689865849794"} 2023-07-20 15:10:49,796 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-20 15:10:49,797 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-20 15:10:49,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 214 msec 2023-07-20 15:10:49,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-20 15:10:49,897 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-20 15:10:49,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-20 15:10:49,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 15:10:49,912 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 15:10:49,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-20 15:10:49,914 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 15:10:49,917 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40765] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-20 15:10:49,920 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b 2023-07-20 15:10:49,920 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584 2023-07-20 15:10:49,921 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 15:10:49,921 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 15:10:49,921 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 15:10:49,921 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-20 15:10:49,922 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:49,922 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:49,922 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:49,923 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-20 15:10:49,923 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 15:10:49,923 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-20 15:10:49,923 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 15:10:49,922 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:49,923 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-20 15:10:49,923 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-20 15:10:49,923 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 15:10:49,923 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 15:10:49,924 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584/cf, FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584/recovered.edits] 2023-07-20 15:10:49,926 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b/cf, FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b/recovered.edits] 2023-07-20 15:10:49,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-20 15:10:49,932 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584/cf/d03e359963764e6fb4a8f927ca556bd5 to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584/cf/d03e359963764e6fb4a8f927ca556bd5 2023-07-20 15:10:49,932 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b/cf/08a8b3a31b2f4ab5b9d030bcae7a0c0b to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b/cf/08a8b3a31b2f4ab5b9d030bcae7a0c0b 2023-07-20 15:10:49,935 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584/recovered.edits/9.seqid to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584/recovered.edits/9.seqid 2023-07-20 15:10:49,936 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b/recovered.edits/9.seqid to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b/recovered.edits/9.seqid 2023-07-20 15:10:49,936 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/ae951278f6c6f3b22cefa70301c56584 2023-07-20 15:10:49,936 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportWithTargetName/1522395558931d54b7a56886581aa33b 2023-07-20 15:10:49,937 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-20 15:10:49,939 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 15:10:49,959 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-20 15:10:49,962 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-20 15:10:49,964 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 15:10:49,964 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-20 15:10:49,964 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865849964"}]},"ts":"9223372036854775807"} 2023-07-20 15:10:49,964 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865849964"}]},"ts":"9223372036854775807"} 2023-07-20 15:10:49,966 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 15:10:49,966 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1522395558931d54b7a56886581aa33b, NAME => 'testtb-testExportWithTargetName,,1689865832926.1522395558931d54b7a56886581aa33b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ae951278f6c6f3b22cefa70301c56584, NAME => 'testtb-testExportWithTargetName,1,1689865832926.ae951278f6c6f3b22cefa70301c56584.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 15:10:49,966 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-20 15:10:49,966 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689865849966"}]},"ts":"9223372036854775807"} 2023-07-20 15:10:49,968 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-20 15:10:49,971 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-20 15:10:49,972 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 68 msec 2023-07-20 15:10:50,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-20 15:10:50,044 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-20 15:10:50,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-20 15:10:50,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-20 15:10:50,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-20 15:10:50,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-20 15:10:50,118 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=755 (was 708) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/cluster_360f6e79-b16a-b730-c2d8-9ed046e7a4b0/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:33065 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/cluster_360f6e79-b16a-b730-c2d8-9ed046e7a4b0/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_44580749_1 at /127.0.0.1:51754 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-201645114_17 at /127.0.0.1:48042 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_44580749_1 at /127.0.0.1:48032 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/cluster_360f6e79-b16a-b730-c2d8-9ed046e7a4b0/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-201645114_17 at /127.0.0.1:51776 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:41943 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-201645114_17 at /127.0.0.1:46798 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/cluster_360f6e79-b16a-b730-c2d8-9ed046e7a4b0/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/cluster_360f6e79-b16a-b730-c2d8-9ed046e7a4b0/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/cluster_360f6e79-b16a-b730-c2d8-9ed046e7a4b0/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=324 (was 265) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=3489 (was 5176) 2023-07-20 15:10:50,118 WARN [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-20 15:10:50,142 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=324, ProcessCount=183, AvailableMemoryMB=3482 2023-07-20 15:10:50,142 WARN [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-20 15:10:50,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 15:10:50,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-20 15:10:50,163 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:10:50,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-20 15:10:50,165 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:10:50,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 15:10:50,178 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f 2023-07-20 15:10:50,180 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f empty. 2023-07-20 15:10:50,181 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f 2023-07-20 15:10:50,182 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2 2023-07-20 15:10:50,183 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2 empty. 2023-07-20 15:10:50,184 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2 2023-07-20 15:10:50,184 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-20 15:10:50,209 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-20 15:10:50,210 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 455531494db88d7c7ce723272bd3165f, NAME => 'testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp 2023-07-20 15:10:50,211 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => ec5bdd1db033f5e7e377eab707494db2, NAME => 'testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp 2023-07-20 15:10:50,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:50,230 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 455531494db88d7c7ce723272bd3165f, disabling compactions & flushes 2023-07-20 15:10:50,230 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. 2023-07-20 15:10:50,230 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. 2023-07-20 15:10:50,230 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. after waiting 0 ms 2023-07-20 15:10:50,230 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. 2023-07-20 15:10:50,230 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. 2023-07-20 15:10:50,230 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 455531494db88d7c7ce723272bd3165f: 2023-07-20 15:10:50,233 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:50,234 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing ec5bdd1db033f5e7e377eab707494db2, disabling compactions & flushes 2023-07-20 15:10:50,234 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. 2023-07-20 15:10:50,234 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. 2023-07-20 15:10:50,234 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. after waiting 0 ms 2023-07-20 15:10:50,234 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. 2023-07-20 15:10:50,234 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. 2023-07-20 15:10:50,235 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for ec5bdd1db033f5e7e377eab707494db2: 2023-07-20 15:10:50,238 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:10:50,239 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865850239"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865850239"}]},"ts":"1689865850239"} 2023-07-20 15:10:50,239 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865850239"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865850239"}]},"ts":"1689865850239"} 2023-07-20 15:10:50,242 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 15:10:50,243 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:10:50,244 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865850243"}]},"ts":"1689865850243"} 2023-07-20 15:10:50,245 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-20 15:10:50,249 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:10:50,251 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:10:50,251 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:10:50,251 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:10:50,251 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:10:50,251 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=455531494db88d7c7ce723272bd3165f, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ec5bdd1db033f5e7e377eab707494db2, ASSIGN}] 2023-07-20 15:10:50,254 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=455531494db88d7c7ce723272bd3165f, ASSIGN 2023-07-20 15:10:50,254 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ec5bdd1db033f5e7e377eab707494db2, ASSIGN 2023-07-20 15:10:50,255 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=455531494db88d7c7ce723272bd3165f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45307,1689865822911; forceNewPlan=false, retain=false 2023-07-20 15:10:50,256 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ec5bdd1db033f5e7e377eab707494db2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33243,1689865822788; forceNewPlan=false, retain=false 2023-07-20 15:10:50,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 15:10:50,406 INFO [jenkins-hbase4:33245] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 15:10:50,409 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ec5bdd1db033f5e7e377eab707494db2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:50,409 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=455531494db88d7c7ce723272bd3165f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:50,409 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865850409"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865850409"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865850409"}]},"ts":"1689865850409"} 2023-07-20 15:10:50,409 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865850409"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865850409"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865850409"}]},"ts":"1689865850409"} 2023-07-20 15:10:50,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure ec5bdd1db033f5e7e377eab707494db2, server=jenkins-hbase4.apache.org,33243,1689865822788}] 2023-07-20 15:10:50,413 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 455531494db88d7c7ce723272bd3165f, server=jenkins-hbase4.apache.org,45307,1689865822911}] 2023-07-20 15:10:50,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 15:10:50,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. 2023-07-20 15:10:50,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec5bdd1db033f5e7e377eab707494db2, NAME => 'testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 15:10:50,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. service=AccessControlService 2023-07-20 15:10:50,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:50,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState ec5bdd1db033f5e7e377eab707494db2 2023-07-20 15:10:50,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:50,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ec5bdd1db033f5e7e377eab707494db2 2023-07-20 15:10:50,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ec5bdd1db033f5e7e377eab707494db2 2023-07-20 15:10:50,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. 2023-07-20 15:10:50,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 455531494db88d7c7ce723272bd3165f, NAME => 'testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 15:10:50,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. service=AccessControlService 2023-07-20 15:10:50,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:10:50,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 455531494db88d7c7ce723272bd3165f 2023-07-20 15:10:50,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:10:50,575 INFO [StoreOpener-ec5bdd1db033f5e7e377eab707494db2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ec5bdd1db033f5e7e377eab707494db2 2023-07-20 15:10:50,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 455531494db88d7c7ce723272bd3165f 2023-07-20 15:10:50,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 455531494db88d7c7ce723272bd3165f 2023-07-20 15:10:50,576 INFO [StoreOpener-455531494db88d7c7ce723272bd3165f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 455531494db88d7c7ce723272bd3165f 2023-07-20 15:10:50,577 DEBUG [StoreOpener-ec5bdd1db033f5e7e377eab707494db2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2/cf 2023-07-20 15:10:50,577 DEBUG [StoreOpener-ec5bdd1db033f5e7e377eab707494db2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2/cf 2023-07-20 15:10:50,577 INFO [StoreOpener-ec5bdd1db033f5e7e377eab707494db2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec5bdd1db033f5e7e377eab707494db2 columnFamilyName cf 2023-07-20 15:10:50,578 INFO [StoreOpener-ec5bdd1db033f5e7e377eab707494db2-1] regionserver.HStore(310): Store=ec5bdd1db033f5e7e377eab707494db2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:50,578 DEBUG [StoreOpener-455531494db88d7c7ce723272bd3165f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f/cf 2023-07-20 15:10:50,579 DEBUG [StoreOpener-455531494db88d7c7ce723272bd3165f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f/cf 2023-07-20 15:10:50,579 INFO [StoreOpener-455531494db88d7c7ce723272bd3165f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 455531494db88d7c7ce723272bd3165f columnFamilyName cf 2023-07-20 15:10:50,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2 2023-07-20 15:10:50,580 INFO [StoreOpener-455531494db88d7c7ce723272bd3165f-1] regionserver.HStore(310): Store=455531494db88d7c7ce723272bd3165f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:10:50,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2 2023-07-20 15:10:50,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f 2023-07-20 15:10:50,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f 2023-07-20 15:10:50,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ec5bdd1db033f5e7e377eab707494db2 2023-07-20 15:10:50,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 455531494db88d7c7ce723272bd3165f 2023-07-20 15:10:50,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:10:50,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:10:50,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ec5bdd1db033f5e7e377eab707494db2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62756000, jitterRate=-0.06486272811889648}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:10:50,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 455531494db88d7c7ce723272bd3165f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61129641, jitterRate=-0.08909736573696136}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:10:50,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ec5bdd1db033f5e7e377eab707494db2: 2023-07-20 15:10:50,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 455531494db88d7c7ce723272bd3165f: 2023-07-20 15:10:50,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f., pid=31, masterSystemTime=1689865850565 2023-07-20 15:10:50,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2., pid=30, masterSystemTime=1689865850564 2023-07-20 15:10:50,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. 2023-07-20 15:10:50,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. 2023-07-20 15:10:50,592 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=455531494db88d7c7ce723272bd3165f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:50,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. 2023-07-20 15:10:50,592 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. 2023-07-20 15:10:50,592 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865850592"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865850592"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865850592"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865850592"}]},"ts":"1689865850592"} 2023-07-20 15:10:50,593 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ec5bdd1db033f5e7e377eab707494db2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:50,593 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865850592"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865850592"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865850592"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865850592"}]},"ts":"1689865850592"} 2023-07-20 15:10:50,596 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-20 15:10:50,598 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 455531494db88d7c7ce723272bd3165f, server=jenkins-hbase4.apache.org,45307,1689865822911 in 181 msec 2023-07-20 15:10:50,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-20 15:10:50,600 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure ec5bdd1db033f5e7e377eab707494db2, server=jenkins-hbase4.apache.org,33243,1689865822788 in 183 msec 2023-07-20 15:10:50,601 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=455531494db88d7c7ce723272bd3165f, ASSIGN in 347 msec 2023-07-20 15:10:50,602 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-20 15:10:50,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ec5bdd1db033f5e7e377eab707494db2, ASSIGN in 349 msec 2023-07-20 15:10:50,603 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:10:50,603 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865850603"}]},"ts":"1689865850603"} 2023-07-20 15:10:50,605 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-20 15:10:50,611 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:10:50,611 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-20 15:10:50,613 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40765] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 15:10:50,616 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:50,616 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:50,616 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:50,616 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:10:50,618 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 15:10:50,618 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 15:10:50,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 15:10:50,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 469 msec 2023-07-20 15:10:50,623 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 15:10:50,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-20 15:10:50,770 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-20 15:10:50,770 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-20 15:10:50,771 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:10:50,774 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-20 15:10:50,774 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:10:50,774 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-20 15:10:50,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:10:50,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865850778 (current time:1689865850778). 2023-07-20 15:10:50,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:10:50,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x7f1ad08e to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:50,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c8fe7df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:50,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:50,797 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:50,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f1ad08e to 127.0.0.1:60098 2023-07-20 15:10:50,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:10:50,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x34ab21ad to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:50,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d9c1916, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:50,907 DEBUG [hconnection-0x1eaea465-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:50,908 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:50,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34ab21ad to 127.0.0.1:60098 2023-07-20 15:10:50,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:10:50,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 15:10:50,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:10:50,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:10:50,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:10:50,921 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:10:50,922 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689866450922 2023-07-20 15:10:50,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:10:50,922 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-20 15:10:50,924 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:10:50,924 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:10:50,925 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:10:50,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-20 15:10:50,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 15:10:50,932 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 15:10:50,933 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689866450933 2023-07-20 15:10:50,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,960 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-20 15:10:50,960 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:50,962 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-20 15:10:50,962 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-20 15:10:50,962 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,962 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,964 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:50,964 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:50,964 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:50,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:50,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:50,964 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:50,964 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:50,964 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:50,965 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:50,965 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:10:50,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 15:10:50,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,965 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 15:10:50,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 15:10:50,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,966 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,966 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 15:10:50,966 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 15:10:50,966 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:50,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-20 15:10:50,967 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,967 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 15:10:50,968 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:50,968 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 15:10:50,967 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 15:10:50,969 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 15:10:50,969 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 15:10:50,968 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 15:10:50,969 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,969 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 15:10:50,969 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 15:10:50,969 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 15:10:50,969 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:50,970 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 15:10:50,970 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-20 15:10:50,970 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-20 15:10:50,972 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,972 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:50,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:50,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:50,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:50,978 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,979 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:50,979 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,979 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:50,979 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:50,979 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,979 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:50,979 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,979 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:50,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:50,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:50,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:50,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:50,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:50,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-20 15:10:50,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@799f916a[Count = 1] remaining members to acquire global barrier 2023-07-20 15:10:50,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:50,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:50,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:50,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:50,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:50,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:50,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:50,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:50,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:50,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-20 15:10:50,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@799f916a[Count = 0] remaining members to acquire global barrier 2023-07-20 15:10:50,983 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 15:10:50,983 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,985 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,985 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,985 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,985 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:10:50,985 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 15:10:50,985 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40765,1689865822857' in zk 2023-07-20 15:10:50,985 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:50,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,985 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:10:50,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,985 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:10:50,985 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:10:50,985 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:50,985 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. 2023-07-20 15:10:50,985 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:10:50,986 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. started... 2023-07-20 15:10:50,986 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:10:50,986 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:10:50,986 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. 2023-07-20 15:10:50,985 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:10:50,987 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. started... 2023-07-20 15:10:50,987 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec5bdd1db033f5e7e377eab707494db2: 2023-07-20 15:10:50,987 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 15:10:50,987 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:50,988 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 15:10:50,989 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,990 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:10:50,990 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:10:50,988 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 455531494db88d7c7ce723272bd3165f: 2023-07-20 15:10:50,990 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:50,990 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:10:50,990 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:10:51,024 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:51,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:10:51,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:10:51,026 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:10:51,044 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. completed. 2023-07-20 15:10:51,044 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. 2023-07-20 15:10:51,044 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:10:51,044 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:10:51,044 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,044 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 15:10:51,044 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45307,1689865822911' in zk 2023-07-20 15:10:51,047 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 15:10:51,047 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,047 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:51,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:51,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:51,047 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 15:10:51,048 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. completed. 2023-07-20 15:10:51,049 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. 2023-07-20 15:10:51,049 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:10:51,049 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:10:51,049 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,049 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-20 15:10:51,049 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33243,1689865822788' in zk 2023-07-20 15:10:51,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:51,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:51,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,051 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 15:10:51,051 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,051 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:51,051 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-20 15:10:51,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:51,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45307,1689865822911': 2023-07-20 15:10:51,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 15:10:51,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:51,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:51,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:51,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:51,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:51,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33243,1689865822788': 2023-07-20 15:10:51,064 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-20 15:10:51,064 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:10:51,064 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:10:51,064 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,064 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:10:51,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 15:10:51,067 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,067 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,067 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,067 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:51,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:51,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,067 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,067 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,067 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,070 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,071 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,071 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:51,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,073 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:51,073 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,074 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,078 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,078 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,079 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,079 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,079 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,079 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,079 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,079 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,079 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,079 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:51,079 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,079 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,081 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,082 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,082 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,082 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,082 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,082 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,082 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,131 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-20 15:10:51,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,131 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-20 15:10:51,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689865850922Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689865851081 (+159 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689865851082 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689865851085 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689865851099 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689865851131 (+32 ms) 2023-07-20 15:10:51,134 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 15:10:51,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 211 msec 2023-07-20 15:10:51,227 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:51,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:10:51,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:10:51,239 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:51,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33243] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:10:51,249 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:51,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45307] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:10:51,253 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-20 15:10:51,253 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. 2023-07-20 15:10:51,255 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:10:51,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:10:51,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865851273 (current time:1689865851273). 2023-07-20 15:10:51,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:10:51,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x7268e3fc to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:51,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c9cb9b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:51,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:51,289 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:51,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7268e3fc to 127.0.0.1:60098 2023-07-20 15:10:51,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:10:51,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x2e0ebbb4 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:10:51,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62e4e92b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:10:51,317 DEBUG [hconnection-0x1dd625a7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:10:51,321 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:10:51,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e0ebbb4 to 127.0.0.1:60098 2023-07-20 15:10:51,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:10:51,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 15:10:51,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:10:51,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:10:51,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:10:51,332 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:10:51,334 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689866451334 2023-07-20 15:10:51,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:10:51,334 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-20 15:10:51,336 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:10:51,336 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:10:51,338 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:10:51,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 15:10:51,344 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-20 15:10:51,346 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 15:10:51,347 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689866451347 2023-07-20 15:10:51,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-20 15:10:51,360 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-20 15:10:51,360 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:51,362 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-20 15:10:51,362 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-20 15:10:51,362 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,363 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,364 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,364 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,364 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,364 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,365 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,365 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,365 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,365 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:10:51,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 15:10:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,366 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 15:10:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 15:10:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-20 15:10:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 15:10:51,366 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 15:10:51,366 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 15:10:51,366 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-20 15:10:51,366 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:51,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 15:10:51,368 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 15:10:51,368 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 15:10:51,368 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 15:10:51,368 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:51,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-20 15:10:51,369 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 15:10:51,369 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-20 15:10:51,369 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:10:51,368 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 15:10:51,370 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-20 15:10:51,370 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 15:10:51,369 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-20 15:10:51,370 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 15:10:51,370 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-20 15:10:51,371 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,371 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:51,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:51,374 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,374 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,374 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,374 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:51,374 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:51,374 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,374 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:51,374 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,374 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:10:51,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:51,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:51,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:51,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-20 15:10:51,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f9297c8[Count = 1] remaining members to acquire global barrier 2023-07-20 15:10:51,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:51,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:51,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:51,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:51,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:51,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:51,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-20 15:10:51,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f9297c8[Count = 0] remaining members to acquire global barrier 2023-07-20 15:10:51,378 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 15:10:51,378 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,380 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,380 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,380 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,380 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:10:51,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,380 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:10:51,380 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:10:51,380 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:10:51,380 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:10:51,380 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. 2023-07-20 15:10:51,380 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:10:51,380 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. 2023-07-20 15:10:51,380 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,381 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. started... 2023-07-20 15:10:51,380 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:10:51,380 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. started... 2023-07-20 15:10:51,380 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 15:10:51,381 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40765,1689865822857' in zk 2023-07-20 15:10:51,381 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,381 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:10:51,381 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ec5bdd1db033f5e7e377eab707494db2 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-20 15:10:51,381 INFO [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 455531494db88d7c7ce723272bd3165f 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-20 15:10:51,383 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 15:10:51,383 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:51,383 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 15:10:51,406 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2/.tmp/cf/6a49b43d62ed446da07f56f11327a613 2023-07-20 15:10:51,407 INFO [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f/.tmp/cf/444127a2e8414e6ea056b5f7630b0883 2023-07-20 15:10:51,416 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2/.tmp/cf/6a49b43d62ed446da07f56f11327a613 as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2/cf/6a49b43d62ed446da07f56f11327a613 2023-07-20 15:10:51,418 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f/.tmp/cf/444127a2e8414e6ea056b5f7630b0883 as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f/cf/444127a2e8414e6ea056b5f7630b0883 2023-07-20 15:10:51,423 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2/cf/6a49b43d62ed446da07f56f11327a613, entries=46, sequenceid=6, filesize=7.9 K 2023-07-20 15:10:51,427 INFO [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f/cf/444127a2e8414e6ea056b5f7630b0883, entries=4, sequenceid=6, filesize=5.1 K 2023-07-20 15:10:51,429 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for ec5bdd1db033f5e7e377eab707494db2 in 48ms, sequenceid=6, compaction requested=false 2023-07-20 15:10:51,429 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-20 15:10:51,429 INFO [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 455531494db88d7c7ce723272bd3165f in 48ms, sequenceid=6, compaction requested=false 2023-07-20 15:10:51,429 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-20 15:10:51,431 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 455531494db88d7c7ce723272bd3165f: 2023-07-20 15:10:51,431 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec5bdd1db033f5e7e377eab707494db2: 2023-07-20 15:10:51,431 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 15:10:51,431 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:10:51,431 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f/cf/444127a2e8414e6ea056b5f7630b0883] hfiles 2023-07-20 15:10:51,431 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f/cf/444127a2e8414e6ea056b5f7630b0883 for snapshot=snaptb0-testExportFileSystemState 2023-07-20 15:10:51,431 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-20 15:10:51,431 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:10:51,431 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2/cf/6a49b43d62ed446da07f56f11327a613] hfiles 2023-07-20 15:10:51,431 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2/cf/6a49b43d62ed446da07f56f11327a613 for snapshot=snaptb0-testExportFileSystemState 2023-07-20 15:10:51,436 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:51,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:10:51,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:10:51,437 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:10:51,447 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. completed. 2023-07-20 15:10:51,447 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. 2023-07-20 15:10:51,447 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:10:51,447 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:10:51,447 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,447 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 15:10:51,447 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45307,1689865822911' in zk 2023-07-20 15:10:51,455 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:51,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:51,455 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 15:10:51,455 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:51,456 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 15:10:51,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:51,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:51,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:51,462 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. completed. 2023-07-20 15:10:51,462 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. 2023-07-20 15:10:51,462 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:10:51,462 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:10:51,462 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,462 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-20 15:10:51,462 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33243,1689865822788' in zk 2023-07-20 15:10:51,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,466 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,466 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-20 15:10:51,466 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:51,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,466 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-20 15:10:51,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:51,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45307,1689865822911': 2023-07-20 15:10:51,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 15:10:51,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:51,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:51,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:51,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:51,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33243,1689865822788': 2023-07-20 15:10:51,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 15:10:51,477 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-20 15:10:51,477 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:10:51,477 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:10:51,477 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-20 15:10:51,477 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:10:51,480 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,480 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,480 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,480 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:10:51,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,480 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,480 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:10:51,480 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,481 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:10:51,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,483 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:51,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:10:51,484 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:51,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:10:51,486 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-20 15:10:51,487 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,488 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,492 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,492 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,492 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,492 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,492 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:10:51,492 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,493 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:10:51,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:10:51,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:10:51,492 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,492 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,500 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:10:51,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,502 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,502 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,502 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:10:51,502 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,502 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:10:51,502 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:10:51,502 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,502 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,493 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-20 15:10:51,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-20 15:10:51,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:10:51,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:10:51,504 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,602 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-20 15:10:51,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,603 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689865851334Consolidate snapshot: snaptb0-testExportFileSystemState at 1689865851503 (+169 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689865851503Writing data manifest for snaptb0-testExportFileSystemState at 1689865851511 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689865851543 (+32 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689865851602 (+59 ms) 2023-07-20 15:10:51,605 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-20 15:10:51,607 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 270 msec 2023-07-20 15:10:51,638 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:10:51,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:10:51,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:10:51,643 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865851643 2023-07-20 15:10:51,643 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34279, tgtDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865851643, rawTgtDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865851643, srcFsUri=hdfs://localhost:34279, srcDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:10:51,670 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34279, inputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:10:51,670 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1073328314_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865851643, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865851643/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,670 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34279, inputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84, snapshotDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-20 15:10:51,699 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865851643/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-20 15:10:51,742 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:51,743 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:51,743 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:51,744 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:51,744 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:51,744 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:51,745 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:51,825 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/hadoop-8807456220031523137.jar 2023-07-20 15:10:51,826 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:51,826 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:51,827 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:51,827 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:51,827 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:51,828 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 15:10:51,828 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 15:10:51,829 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 15:10:51,829 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 15:10:51,830 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 15:10:51,834 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 15:10:51,834 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 15:10:51,835 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 15:10:51,835 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 15:10:51,835 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 15:10:51,836 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 15:10:51,836 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:10:51,837 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:10:51,837 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:10:51,837 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:10:51,838 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:10:51,838 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:10:51,839 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:10:52,910 WARN [Listener at jenkins-hbase4.apache.org/37809] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 15:10:52,913 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-20 15:10:52,916 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-20 15:10:54,636 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:10:54,636 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:10:54,644 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0001_000001 (auth:SIMPLE) 2023-07-20 15:10:54,849 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0002_000001 (auth:SIMPLE) 2023-07-20 15:10:55,395 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 15:10:59,701 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0002_000001 (auth:SIMPLE) 2023-07-20 15:11:01,952 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0002_000001 (auth:SIMPLE) 2023-07-20 15:11:04,979 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0002_000001 (auth:SIMPLE) 2023-07-20 15:11:06,165 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 15:11:06,166 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 15:11:06,174 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-20 15:11:06,174 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 15:11:06,174 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 15:11:06,175 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-201645114_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 15:11:06,175 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-20 15:11:06,175 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-20 15:11:06,175 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-201645114_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865851643/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865851643/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-20 15:11:06,176 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865851643/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-20 15:11:06,176 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865851643/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-20 15:11:06,183 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-20 15:11:06,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-20 15:11:06,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-20 15:11:06,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 15:11:06,189 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865866189"}]},"ts":"1689865866189"} 2023-07-20 15:11:06,191 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-20 15:11:06,194 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-20 15:11:06,195 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=455531494db88d7c7ce723272bd3165f, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ec5bdd1db033f5e7e377eab707494db2, UNASSIGN}] 2023-07-20 15:11:06,197 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=455531494db88d7c7ce723272bd3165f, UNASSIGN 2023-07-20 15:11:06,197 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ec5bdd1db033f5e7e377eab707494db2, UNASSIGN 2023-07-20 15:11:06,198 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=455531494db88d7c7ce723272bd3165f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:06,198 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865866198"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865866198"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865866198"}]},"ts":"1689865866198"} 2023-07-20 15:11:06,198 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ec5bdd1db033f5e7e377eab707494db2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:06,198 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865866198"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865866198"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865866198"}]},"ts":"1689865866198"} 2023-07-20 15:11:06,200 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 455531494db88d7c7ce723272bd3165f, server=jenkins-hbase4.apache.org,45307,1689865822911}] 2023-07-20 15:11:06,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure ec5bdd1db033f5e7e377eab707494db2, server=jenkins-hbase4.apache.org,33243,1689865822788}] 2023-07-20 15:11:06,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 15:11:06,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 455531494db88d7c7ce723272bd3165f 2023-07-20 15:11:06,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 455531494db88d7c7ce723272bd3165f, disabling compactions & flushes 2023-07-20 15:11:06,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. 2023-07-20 15:11:06,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. 2023-07-20 15:11:06,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. after waiting 0 ms 2023-07-20 15:11:06,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. 2023-07-20 15:11:06,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ec5bdd1db033f5e7e377eab707494db2 2023-07-20 15:11:06,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ec5bdd1db033f5e7e377eab707494db2, disabling compactions & flushes 2023-07-20 15:11:06,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. 2023-07-20 15:11:06,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. 2023-07-20 15:11:06,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. after waiting 0 ms 2023-07-20 15:11:06,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. 2023-07-20 15:11:06,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:11:06,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:11:06,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:11:06,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:11:06,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2. 2023-07-20 15:11:06,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f. 2023-07-20 15:11:06,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ec5bdd1db033f5e7e377eab707494db2: 2023-07-20 15:11:06,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 455531494db88d7c7ce723272bd3165f: 2023-07-20 15:11:06,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 455531494db88d7c7ce723272bd3165f 2023-07-20 15:11:06,372 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=455531494db88d7c7ce723272bd3165f, regionState=CLOSED 2023-07-20 15:11:06,373 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865866372"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865866372"}]},"ts":"1689865866372"} 2023-07-20 15:11:06,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ec5bdd1db033f5e7e377eab707494db2 2023-07-20 15:11:06,373 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ec5bdd1db033f5e7e377eab707494db2, regionState=CLOSED 2023-07-20 15:11:06,373 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689865866373"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865866373"}]},"ts":"1689865866373"} 2023-07-20 15:11:06,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-20 15:11:06,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 455531494db88d7c7ce723272bd3165f, server=jenkins-hbase4.apache.org,45307,1689865822911 in 175 msec 2023-07-20 15:11:06,381 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-20 15:11:06,381 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=455531494db88d7c7ce723272bd3165f, UNASSIGN in 184 msec 2023-07-20 15:11:06,381 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure ec5bdd1db033f5e7e377eab707494db2, server=jenkins-hbase4.apache.org,33243,1689865822788 in 174 msec 2023-07-20 15:11:06,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-20 15:11:06,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ec5bdd1db033f5e7e377eab707494db2, UNASSIGN in 186 msec 2023-07-20 15:11:06,384 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865866384"}]},"ts":"1689865866384"} 2023-07-20 15:11:06,385 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-20 15:11:06,387 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-20 15:11:06,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 204 msec 2023-07-20 15:11:06,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-20 15:11:06,491 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-20 15:11:06,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-20 15:11:06,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 15:11:06,496 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 15:11:06,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-20 15:11:06,496 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 15:11:06,498 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40765] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-20 15:11:06,501 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 15:11:06,501 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 15:11:06,501 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 15:11:06,501 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 15:11:06,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 15:11:06,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 15:11:06,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 15:11:06,502 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-20 15:11:06,502 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f 2023-07-20 15:11:06,502 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2 2023-07-20 15:11:06,503 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 15:11:06,503 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 15:11:06,503 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:06,503 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:06,503 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 15:11:06,503 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-20 15:11:06,503 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:06,503 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:06,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-20 15:11:06,505 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2/cf, FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2/recovered.edits] 2023-07-20 15:11:06,505 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f/cf, FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f/recovered.edits] 2023-07-20 15:11:06,509 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2/cf/6a49b43d62ed446da07f56f11327a613 to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2/cf/6a49b43d62ed446da07f56f11327a613 2023-07-20 15:11:06,509 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f/cf/444127a2e8414e6ea056b5f7630b0883 to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f/cf/444127a2e8414e6ea056b5f7630b0883 2023-07-20 15:11:06,513 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2/recovered.edits/9.seqid to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2/recovered.edits/9.seqid 2023-07-20 15:11:06,513 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f/recovered.edits/9.seqid to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f/recovered.edits/9.seqid 2023-07-20 15:11:06,513 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/ec5bdd1db033f5e7e377eab707494db2 2023-07-20 15:11:06,514 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemState/455531494db88d7c7ce723272bd3165f 2023-07-20 15:11:06,514 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-20 15:11:06,516 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 15:11:06,519 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-20 15:11:06,522 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-20 15:11:06,523 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 15:11:06,523 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-20 15:11:06,523 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865866523"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:06,523 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865866523"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:06,525 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 15:11:06,525 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 455531494db88d7c7ce723272bd3165f, NAME => 'testtb-testExportFileSystemState,,1689865850147.455531494db88d7c7ce723272bd3165f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ec5bdd1db033f5e7e377eab707494db2, NAME => 'testtb-testExportFileSystemState,1,1689865850147.ec5bdd1db033f5e7e377eab707494db2.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 15:11:06,525 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-20 15:11:06,526 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689865866525"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:06,528 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-20 15:11:06,530 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-20 15:11:06,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 38 msec 2023-07-20 15:11:06,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-20 15:11:06,606 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-20 15:11:06,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-20 15:11:06,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-20 15:11:06,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-20 15:11:06,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-20 15:11:06,646 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=769 (was 755) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-201645114_17 at /127.0.0.1:42024 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-201645114_17 at /127.0.0.1:50248 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:35279 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1732957272_1 at /127.0.0.1:33152 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-201645114_17 at /127.0.0.1:33184 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1732957272_1 at /127.0.0.1:42006 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:37809 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1950 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 916) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=358 (was 324) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=3171 (was 3482) 2023-07-20 15:11:06,646 WARN [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-07-20 15:11:06,666 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=769, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=358, ProcessCount=183, AvailableMemoryMB=3169 2023-07-20 15:11:06,666 WARN [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(130): Thread=769 is superior to 500 2023-07-20 15:11:06,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 15:11:06,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-20 15:11:06,672 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:11:06,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-20 15:11:06,673 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:11:06,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 15:11:06,676 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804 2023-07-20 15:11:06,676 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b 2023-07-20 15:11:06,676 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804 empty. 2023-07-20 15:11:06,676 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b empty. 2023-07-20 15:11:06,677 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804 2023-07-20 15:11:06,677 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b 2023-07-20 15:11:06,677 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-20 15:11:06,696 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-20 15:11:06,697 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => a03cdb5071ecffe79d856ff7e26f0804, NAME => 'testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp 2023-07-20 15:11:06,698 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => ac199795930fd7d51d66c2ef34e1c81b, NAME => 'testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp 2023-07-20 15:11:06,717 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:06,718 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing a03cdb5071ecffe79d856ff7e26f0804, disabling compactions & flushes 2023-07-20 15:11:06,718 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. 2023-07-20 15:11:06,718 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. 2023-07-20 15:11:06,718 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. after waiting 0 ms 2023-07-20 15:11:06,718 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. 2023-07-20 15:11:06,718 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. 2023-07-20 15:11:06,718 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for a03cdb5071ecffe79d856ff7e26f0804: 2023-07-20 15:11:06,719 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:06,720 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing ac199795930fd7d51d66c2ef34e1c81b, disabling compactions & flushes 2023-07-20 15:11:06,720 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. 2023-07-20 15:11:06,720 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. 2023-07-20 15:11:06,720 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. after waiting 0 ms 2023-07-20 15:11:06,720 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. 2023-07-20 15:11:06,720 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. 2023-07-20 15:11:06,720 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for ac199795930fd7d51d66c2ef34e1c81b: 2023-07-20 15:11:06,723 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:11:06,724 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865866724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865866724"}]},"ts":"1689865866724"} 2023-07-20 15:11:06,724 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865866724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865866724"}]},"ts":"1689865866724"} 2023-07-20 15:11:06,727 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 15:11:06,728 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:11:06,728 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865866728"}]},"ts":"1689865866728"} 2023-07-20 15:11:06,729 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-20 15:11:06,734 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:11:06,735 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:11:06,736 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:11:06,736 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:11:06,736 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:11:06,736 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a03cdb5071ecffe79d856ff7e26f0804, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ac199795930fd7d51d66c2ef34e1c81b, ASSIGN}] 2023-07-20 15:11:06,741 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a03cdb5071ecffe79d856ff7e26f0804, ASSIGN 2023-07-20 15:11:06,741 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ac199795930fd7d51d66c2ef34e1c81b, ASSIGN 2023-07-20 15:11:06,742 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a03cdb5071ecffe79d856ff7e26f0804, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33243,1689865822788; forceNewPlan=false, retain=false 2023-07-20 15:11:06,742 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ac199795930fd7d51d66c2ef34e1c81b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40765,1689865822857; forceNewPlan=false, retain=false 2023-07-20 15:11:06,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 15:11:06,892 INFO [jenkins-hbase4:33245] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 15:11:06,895 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ac199795930fd7d51d66c2ef34e1c81b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:06,895 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a03cdb5071ecffe79d856ff7e26f0804, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:06,895 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865866895"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865866895"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865866895"}]},"ts":"1689865866895"} 2023-07-20 15:11:06,895 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865866895"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865866895"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865866895"}]},"ts":"1689865866895"} 2023-07-20 15:11:06,897 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure ac199795930fd7d51d66c2ef34e1c81b, server=jenkins-hbase4.apache.org,40765,1689865822857}] 2023-07-20 15:11:06,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure a03cdb5071ecffe79d856ff7e26f0804, server=jenkins-hbase4.apache.org,33243,1689865822788}] 2023-07-20 15:11:06,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 15:11:07,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. 2023-07-20 15:11:07,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a03cdb5071ecffe79d856ff7e26f0804, NAME => 'testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 15:11:07,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. 2023-07-20 15:11:07,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ac199795930fd7d51d66c2ef34e1c81b, NAME => 'testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 15:11:07,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. service=AccessControlService 2023-07-20 15:11:07,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. service=AccessControlService 2023-07-20 15:11:07,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:11:07,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a03cdb5071ecffe79d856ff7e26f0804 2023-07-20 15:11:07,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:11:07,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:07,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ac199795930fd7d51d66c2ef34e1c81b 2023-07-20 15:11:07,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a03cdb5071ecffe79d856ff7e26f0804 2023-07-20 15:11:07,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:07,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a03cdb5071ecffe79d856ff7e26f0804 2023-07-20 15:11:07,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ac199795930fd7d51d66c2ef34e1c81b 2023-07-20 15:11:07,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ac199795930fd7d51d66c2ef34e1c81b 2023-07-20 15:11:07,063 INFO [StoreOpener-a03cdb5071ecffe79d856ff7e26f0804-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a03cdb5071ecffe79d856ff7e26f0804 2023-07-20 15:11:07,063 INFO [StoreOpener-ac199795930fd7d51d66c2ef34e1c81b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ac199795930fd7d51d66c2ef34e1c81b 2023-07-20 15:11:07,065 DEBUG [StoreOpener-a03cdb5071ecffe79d856ff7e26f0804-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804/cf 2023-07-20 15:11:07,065 DEBUG [StoreOpener-ac199795930fd7d51d66c2ef34e1c81b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b/cf 2023-07-20 15:11:07,065 DEBUG [StoreOpener-ac199795930fd7d51d66c2ef34e1c81b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b/cf 2023-07-20 15:11:07,065 DEBUG [StoreOpener-a03cdb5071ecffe79d856ff7e26f0804-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804/cf 2023-07-20 15:11:07,066 INFO [StoreOpener-ac199795930fd7d51d66c2ef34e1c81b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac199795930fd7d51d66c2ef34e1c81b columnFamilyName cf 2023-07-20 15:11:07,066 INFO [StoreOpener-a03cdb5071ecffe79d856ff7e26f0804-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a03cdb5071ecffe79d856ff7e26f0804 columnFamilyName cf 2023-07-20 15:11:07,066 INFO [StoreOpener-a03cdb5071ecffe79d856ff7e26f0804-1] regionserver.HStore(310): Store=a03cdb5071ecffe79d856ff7e26f0804/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:11:07,066 INFO [StoreOpener-ac199795930fd7d51d66c2ef34e1c81b-1] regionserver.HStore(310): Store=ac199795930fd7d51d66c2ef34e1c81b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:11:07,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804 2023-07-20 15:11:07,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b 2023-07-20 15:11:07,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804 2023-07-20 15:11:07,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b 2023-07-20 15:11:07,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a03cdb5071ecffe79d856ff7e26f0804 2023-07-20 15:11:07,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ac199795930fd7d51d66c2ef34e1c81b 2023-07-20 15:11:07,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:11:07,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:11:07,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a03cdb5071ecffe79d856ff7e26f0804; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75286594, jitterRate=0.1218576729297638}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:11:07,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a03cdb5071ecffe79d856ff7e26f0804: 2023-07-20 15:11:07,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ac199795930fd7d51d66c2ef34e1c81b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74251001, jitterRate=0.10642613470554352}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:11:07,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ac199795930fd7d51d66c2ef34e1c81b: 2023-07-20 15:11:07,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804., pid=46, masterSystemTime=1689865867050 2023-07-20 15:11:07,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b., pid=45, masterSystemTime=1689865867049 2023-07-20 15:11:07,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. 2023-07-20 15:11:07,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. 2023-07-20 15:11:07,078 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a03cdb5071ecffe79d856ff7e26f0804, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. 2023-07-20 15:11:07,078 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865867077"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865867077"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865867077"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865867077"}]},"ts":"1689865867077"} 2023-07-20 15:11:07,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. 2023-07-20 15:11:07,079 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ac199795930fd7d51d66c2ef34e1c81b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,079 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865867079"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865867079"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865867079"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865867079"}]},"ts":"1689865867079"} 2023-07-20 15:11:07,082 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-20 15:11:07,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure a03cdb5071ecffe79d856ff7e26f0804, server=jenkins-hbase4.apache.org,33243,1689865822788 in 182 msec 2023-07-20 15:11:07,083 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-20 15:11:07,084 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure ac199795930fd7d51d66c2ef34e1c81b, server=jenkins-hbase4.apache.org,40765,1689865822857 in 184 msec 2023-07-20 15:11:07,084 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a03cdb5071ecffe79d856ff7e26f0804, ASSIGN in 347 msec 2023-07-20 15:11:07,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-20 15:11:07,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ac199795930fd7d51d66c2ef34e1c81b, ASSIGN in 348 msec 2023-07-20 15:11:07,087 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:11:07,087 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865867087"}]},"ts":"1689865867087"} 2023-07-20 15:11:07,088 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-20 15:11:07,091 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:11:07,091 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-20 15:11:07,093 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40765] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 15:11:07,095 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:07,095 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:07,095 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:07,095 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:07,096 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:07,096 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:07,097 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:07,097 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:07,098 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 429 msec 2023-07-20 15:11:07,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-20 15:11:07,277 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-20 15:11:07,277 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-20 15:11:07,277 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:11:07,294 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-20 15:11:07,295 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:11:07,295 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-20 15:11:07,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 15:11:07,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865867298 (current time:1689865867298). 2023-07-20 15:11:07,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:11:07,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x48d46c7a to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:07,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5baea0c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:07,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:07,312 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:07,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48d46c7a to 127.0.0.1:60098 2023-07-20 15:11:07,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:07,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x1ea186fd to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:07,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@757d9eef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:07,325 DEBUG [hconnection-0x5bfbb01f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:07,327 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48118, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:07,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ea186fd to 127.0.0.1:60098 2023-07-20 15:11:07,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:07,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 15:11:07,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:11:07,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 15:11:07,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 15:11:07,337 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 15:11:07,340 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689866467340 2023-07-20 15:11:07,340 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-20 15:11:07,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 15:11:07,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 15:11:07,343 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 15:11:07,343 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:11:07,343 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:11:07,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-20 15:11:07,345 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 15:11:07,346 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689866467346 2023-07-20 15:11:07,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,370 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-20 15:11:07,370 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:07,371 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-20 15:11:07,371 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-20 15:11:07,371 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,371 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,373 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:07,373 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:07,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:07,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:07,373 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,373 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:07,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:07,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:07,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:07,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:07,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,374 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,375 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 15:11:07,375 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,375 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:11:07,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 15:11:07,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-20 15:11:07,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,375 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 15:11:07,376 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 15:11:07,376 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 15:11:07,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,376 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 15:11:07,376 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:07,376 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 15:11:07,377 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 15:11:07,377 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 15:11:07,377 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 15:11:07,377 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:07,376 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 15:11:07,379 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:07,378 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 15:11:07,417 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 15:11:07,417 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 15:11:07,417 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 15:11:07,419 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-20 15:11:07,419 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-20 15:11:07,420 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,422 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,422 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,422 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:07,422 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:07,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:07,423 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,423 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:07,423 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,423 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:07,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:07,424 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,424 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:07,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:07,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:07,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-20 15:11:07,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71d9bdcc[Count = 1] remaining members to acquire global barrier 2023-07-20 15:11:07,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:07,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:07,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-20 15:11:07,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71d9bdcc[Count = 0] remaining members to acquire global barrier 2023-07-20 15:11:07,428 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-20 15:11:07,428 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,429 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,429 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,429 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,429 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 15:11:07,429 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,429 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 15:11:07,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,430 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 15:11:07,430 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 15:11:07,429 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45307,1689865822911' in zk 2023-07-20 15:11:07,430 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,430 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:11:07,430 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:07,430 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:07,430 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:07,430 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:07,430 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. 2023-07-20 15:11:07,430 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. 2023-07-20 15:11:07,430 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. started... 2023-07-20 15:11:07,430 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. started... 2023-07-20 15:11:07,432 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a03cdb5071ecffe79d856ff7e26f0804: 2023-07-20 15:11:07,432 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ac199795930fd7d51d66c2ef34e1c81b: 2023-07-20 15:11:07,432 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,432 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,433 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:07,433 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:07,433 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:11:07,433 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:11:07,438 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 15:11:07,438 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:07,438 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 15:11:07,443 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:07,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 15:11:07,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:07,445 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:11:07,454 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. completed. 2023-07-20 15:11:07,454 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. 2023-07-20 15:11:07,454 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:07,454 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:07,454 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,455 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 15:11:07,455 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40765,1689865822857' in zk 2023-07-20 15:11:07,458 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,458 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 15:11:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:07,458 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:07,458 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 15:11:07,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:07,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:07,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:07,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:07,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40765,1689865822857': 2023-07-20 15:11:07,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-20 15:11:07,507 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-20 15:11:07,645 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:07,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 15:11:07,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:07,646 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 15:11:07,858 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. completed. 2023-07-20 15:11:07,858 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. 2023-07-20 15:11:07,858 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:07,858 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:07,858 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,858 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-20 15:11:07,858 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33243,1689865822788' in zk 2023-07-20 15:11:07,860 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,860 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 15:11:07,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:07,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:07,860 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:07,860 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-20 15:11:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33243,1689865822788': 2023-07-20 15:11:07,865 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-20 15:11:07,865 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-20 15:11:07,865 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:11:07,865 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:11:07,865 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,865 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:11:07,867 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,867 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,867 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:07,867 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:07,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,867 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,867 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:07,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,867 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,867 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:07,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:07,868 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:07,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,868 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:07,870 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,871 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:07,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:07,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,871 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,875 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,875 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:07,875 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:07,875 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:07,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:07,875 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:07,875 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:07,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:07,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:07,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:07,875 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:07,875 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:07,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:07,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:07,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:07,876 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,876 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:07,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,876 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:07,878 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,878 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,878 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:07,878 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,878 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:07,878 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:07,878 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,878 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:07,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:07,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:07,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:07,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,918 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-20 15:11:07,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,918 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:07,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689865867340Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689865867876 (+536 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689865867878 (+2 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689865867882 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689865867890 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689865867918 (+28 ms) 2023-07-20 15:11:07,921 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 15:11:07,923 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 580 msec 2023-07-20 15:11:07,946 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:07,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 15:11:07,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:11:07,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33243] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:11:07,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40765] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:11:07,959 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-20 15:11:07,959 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. 2023-07-20 15:11:07,960 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:11:07,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 15:11:07,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865867972 (current time:1689865867972). 2023-07-20 15:11:07,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:11:07,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x624745b2 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:07,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f254e97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:07,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:07,994 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:07,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x624745b2 to 127.0.0.1:60098 2023-07-20 15:11:07,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:07,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x50218c97 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:08,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@81339f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:08,010 DEBUG [hconnection-0x1dd79f97-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:08,011 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:08,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50218c97 to 127.0.0.1:60098 2023-07-20 15:11:08,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:08,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-20 15:11:08,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:11:08,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 15:11:08,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 15:11:08,024 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 15:11:08,025 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689866468025 2023-07-20 15:11:08,025 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-20 15:11:08,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-20 15:11:08,027 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:11:08,027 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:11:08,028 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-20 15:11:08,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 15:11:08,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-20 15:11:08,031 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 15:11:08,031 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689866468031 2023-07-20 15:11:08,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-20 15:11:08,045 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-20 15:11:08,045 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:08,047 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-20 15:11:08,047 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-20 15:11:08,048 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,048 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,049 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:08,049 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:08,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:08,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:08,049 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:08,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:08,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:08,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:08,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,050 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:08,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,051 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,051 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,051 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 15:11:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,052 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 15:11:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 15:11:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-20 15:11:08,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,053 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 15:11:08,052 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,053 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:11:08,052 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 15:11:08,053 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 15:11:08,055 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 15:11:08,055 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 15:11:08,055 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:08,052 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-20 15:11:08,056 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 15:11:08,057 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 15:11:08,057 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 15:11:08,055 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:08,058 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,058 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:08,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:08,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:08,059 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,059 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:08,060 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-20 15:11:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:08,061 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-20 15:11:08,061 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:08,061 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 15:11:08,061 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 15:11:08,062 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 15:11:08,063 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-20 15:11:08,063 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-20 15:11:08,063 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-20 15:11:08,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:08,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,064 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,064 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,066 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,066 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,066 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:08,067 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,067 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:08,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-20 15:11:08,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b8feba1[Count = 1] remaining members to acquire global barrier 2023-07-20 15:11:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:08,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:08,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:08,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:08,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-20 15:11:08,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b8feba1[Count = 0] remaining members to acquire global barrier 2023-07-20 15:11:08,069 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-20 15:11:08,069 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,070 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,070 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,070 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,071 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 15:11:08,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,071 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,071 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:08,071 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:08,071 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. 2023-07-20 15:11:08,071 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,071 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. started... 2023-07-20 15:11:08,071 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 15:11:08,071 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:11:08,071 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-20 15:11:08,071 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 15:11:08,071 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45307,1689865822911' in zk 2023-07-20 15:11:08,071 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:08,072 INFO [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ac199795930fd7d51d66c2ef34e1c81b 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-20 15:11:08,072 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. 2023-07-20 15:11:08,072 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:08,073 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. started... 2023-07-20 15:11:08,073 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a03cdb5071ecffe79d856ff7e26f0804 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-20 15:11:08,073 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 15:11:08,073 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:08,073 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 15:11:08,102 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804/.tmp/cf/485e9f454ec04669a591b561d387479a 2023-07-20 15:11:08,102 INFO [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b/.tmp/cf/d419df1bb8e74e41abb7ee525ec941cd 2023-07-20 15:11:08,121 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b/.tmp/cf/d419df1bb8e74e41abb7ee525ec941cd as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b/cf/d419df1bb8e74e41abb7ee525ec941cd 2023-07-20 15:11:08,121 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804/.tmp/cf/485e9f454ec04669a591b561d387479a as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804/cf/485e9f454ec04669a591b561d387479a 2023-07-20 15:11:08,127 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804/cf/485e9f454ec04669a591b561d387479a, entries=4, sequenceid=6, filesize=5.1 K 2023-07-20 15:11:08,127 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:08,127 INFO [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b/cf/d419df1bb8e74e41abb7ee525ec941cd, entries=46, sequenceid=6, filesize=7.9 K 2023-07-20 15:11:08,128 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for a03cdb5071ecffe79d856ff7e26f0804 in 55ms, sequenceid=6, compaction requested=false 2023-07-20 15:11:08,130 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a03cdb5071ecffe79d856ff7e26f0804: 2023-07-20 15:11:08,130 INFO [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for ac199795930fd7d51d66c2ef34e1c81b in 57ms, sequenceid=6, compaction requested=false 2023-07-20 15:11:08,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 15:11:08,130 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ac199795930fd7d51d66c2ef34e1c81b: 2023-07-20 15:11:08,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:08,130 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 15:11:08,130 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-20 15:11:08,130 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:08,130 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:08,131 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:11:08,131 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b/cf/d419df1bb8e74e41abb7ee525ec941cd] hfiles 2023-07-20 15:11:08,131 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b/cf/d419df1bb8e74e41abb7ee525ec941cd for snapshot=snaptb0-testConsecutiveExports 2023-07-20 15:11:08,131 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804/cf/485e9f454ec04669a591b561d387479a] hfiles 2023-07-20 15:11:08,131 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804/cf/485e9f454ec04669a591b561d387479a for snapshot=snaptb0-testConsecutiveExports 2023-07-20 15:11:08,161 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. completed. 2023-07-20 15:11:08,161 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. 2023-07-20 15:11:08,161 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:08,161 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:08,162 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,162 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 15:11:08,162 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40765,1689865822857' in zk 2023-07-20 15:11:08,164 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,164 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 15:11:08,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:08,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:08,164 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:08,164 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 15:11:08,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:08,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:08,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:08,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:08,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:08,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:08,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:08,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40765,1689865822857': 2023-07-20 15:11:08,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-20 15:11:08,172 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. completed. 2023-07-20 15:11:08,173 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. 2023-07-20 15:11:08,173 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:08,173 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:08,173 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,173 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-20 15:11:08,173 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33243,1689865822788' in zk 2023-07-20 15:11:08,176 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-20 15:11:08,176 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,176 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:08,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:08,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:08,176 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-20 15:11:08,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:08,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:08,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:08,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:08,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:08,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:08,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:08,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33243,1689865822788': 2023-07-20 15:11:08,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-20 15:11:08,192 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-20 15:11:08,193 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:11:08,193 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:11:08,193 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-20 15:11:08,193 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:11:08,195 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,195 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,195 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,195 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,195 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:08,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:08,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:08,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,195 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:08,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,195 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:08,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:08,196 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:08,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:08,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:08,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:08,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:08,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:08,196 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:08,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,197 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:08,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:08,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:08,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-20 15:11:08,199 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,200 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:08,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,200 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:08,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,207 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:08,207 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:08,207 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:08,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:08,208 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:08,208 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:08,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:08,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:08,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:08,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:08,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:08,208 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:08,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:08,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:08,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:08,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:08,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:08,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:08,214 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:08,214 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,214 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,214 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,214 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,214 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:08,214 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,214 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:08,214 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:08,214 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:08,214 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,214 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-20 15:11:08,214 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-20 15:11:08,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,262 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-20 15:11:08,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,262 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689865868025Consolidate snapshot: snaptb0-testConsecutiveExports at 1689865868216 (+191 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689865868216Writing data manifest for snaptb0-testConsecutiveExports at 1689865868220 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689865868228 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689865868262 (+34 ms) 2023-07-20 15:11:08,265 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-20 15:11:08,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 239 msec 2023-07-20 15:11:08,331 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:08,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-20 15:11:08,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:11:08,332 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332 2023-07-20 15:11:08,333 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332, srcFsUri=hdfs://localhost:34279, srcDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:11:08,356 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34279, inputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:11:08,356 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@24842805, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,356 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34279, inputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84, snapshotDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-20 15:11:08,364 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 15:11:08,376 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:08,377 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:08,377 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:08,378 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:08,378 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:08,378 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:08,379 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:08,460 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/hadoop-2555444012762562707.jar 2023-07-20 15:11:08,461 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:08,461 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:08,462 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:08,462 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:08,463 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:08,463 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:08,464 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 15:11:08,465 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 15:11:08,465 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 15:11:08,465 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 15:11:08,466 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 15:11:08,466 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 15:11:08,467 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 15:11:08,467 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 15:11:08,468 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 15:11:08,468 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 15:11:08,469 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:08,469 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:08,470 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:08,470 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:08,470 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:08,470 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:08,471 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:08,913 WARN [Listener at jenkins-hbase4.apache.org/37809] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 15:11:08,916 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-20 15:11:08,918 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-20 15:11:11,170 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:11:11,170 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:11:11,173 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0002_000001 (auth:SIMPLE) 2023-07-20 15:11:11,648 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0003_000001 (auth:SIMPLE) 2023-07-20 15:11:11,960 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 15:11:16,513 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0003_000001 (auth:SIMPLE) 2023-07-20 15:11:18,763 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0003_000001 (auth:SIMPLE) 2023-07-20 15:11:21,686 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0003_000001 (auth:SIMPLE) 2023-07-20 15:11:23,140 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 15:11:23,140 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 15:11:23,144 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-20 15:11:23,144 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 15:11:23,145 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 15:11:23,145 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-201645114_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 15:11:23,147 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 15:11:23,147 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 15:11:23,147 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@9381970 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 15:11:23,147 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 15:11:23,148 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 15:11:23,149 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332, srcFsUri=hdfs://localhost:34279, srcDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:11:23,174 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34279, inputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:11:23,174 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@47c4edac, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 15:11:23,174 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34279, inputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84, snapshotDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-20 15:11:23,185 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-20 15:11:23,197 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,198 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,198 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,198 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,199 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,199 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,199 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,268 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/hadoop-7809686483553737723.jar 2023-07-20 15:11:23,269 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,269 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,270 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,270 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,270 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,271 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:23,271 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 15:11:23,271 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 15:11:23,272 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 15:11:23,272 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 15:11:23,272 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 15:11:23,273 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 15:11:23,273 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 15:11:23,274 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 15:11:23,274 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 15:11:23,274 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 15:11:23,275 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:23,275 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:23,276 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:23,276 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:23,276 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:23,276 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:23,277 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:23,660 WARN [Listener at jenkins-hbase4.apache.org/37809] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 15:11:23,662 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-20 15:11:23,665 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-20 15:11:27,856 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:11:27,856 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:11:27,859 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0003_000001 (auth:SIMPLE) 2023-07-20 15:11:28,184 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0004_000001 (auth:SIMPLE) 2023-07-20 15:11:32,882 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0004_000001 (auth:SIMPLE) 2023-07-20 15:11:35,112 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0004_000001 (auth:SIMPLE) 2023-07-20 15:11:38,506 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0004_000001 (auth:SIMPLE) 2023-07-20 15:11:39,905 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 15:11:39,906 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 15:11:39,910 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-20 15:11:39,911 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 15:11:39,911 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 15:11:39,911 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-201645114_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 15:11:39,919 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 15:11:39,919 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 15:11:39,919 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@9381970 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-20 15:11:39,920 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-20 15:11:39,920 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/local-export-1689865868332/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-20 15:11:39,934 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-20 15:11:39,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-20 15:11:39,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-20 15:11:39,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 15:11:39,945 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865899945"}]},"ts":"1689865899945"} 2023-07-20 15:11:39,947 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-20 15:11:39,949 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-20 15:11:39,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a03cdb5071ecffe79d856ff7e26f0804, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ac199795930fd7d51d66c2ef34e1c81b, UNASSIGN}] 2023-07-20 15:11:39,960 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ac199795930fd7d51d66c2ef34e1c81b, UNASSIGN 2023-07-20 15:11:39,963 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a03cdb5071ecffe79d856ff7e26f0804, UNASSIGN 2023-07-20 15:11:39,964 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ac199795930fd7d51d66c2ef34e1c81b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:39,965 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865899964"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865899964"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865899964"}]},"ts":"1689865899964"} 2023-07-20 15:11:39,965 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a03cdb5071ecffe79d856ff7e26f0804, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:39,965 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865899965"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865899965"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865899965"}]},"ts":"1689865899965"} 2023-07-20 15:11:39,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure ac199795930fd7d51d66c2ef34e1c81b, server=jenkins-hbase4.apache.org,40765,1689865822857}] 2023-07-20 15:11:39,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure a03cdb5071ecffe79d856ff7e26f0804, server=jenkins-hbase4.apache.org,33243,1689865822788}] 2023-07-20 15:11:40,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 15:11:40,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a03cdb5071ecffe79d856ff7e26f0804 2023-07-20 15:11:40,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ac199795930fd7d51d66c2ef34e1c81b 2023-07-20 15:11:40,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a03cdb5071ecffe79d856ff7e26f0804, disabling compactions & flushes 2023-07-20 15:11:40,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ac199795930fd7d51d66c2ef34e1c81b, disabling compactions & flushes 2023-07-20 15:11:40,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. 2023-07-20 15:11:40,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. 2023-07-20 15:11:40,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. 2023-07-20 15:11:40,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. 2023-07-20 15:11:40,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. after waiting 0 ms 2023-07-20 15:11:40,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. 2023-07-20 15:11:40,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. after waiting 0 ms 2023-07-20 15:11:40,133 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. 2023-07-20 15:11:40,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:11:40,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:11:40,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804. 2023-07-20 15:11:40,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a03cdb5071ecffe79d856ff7e26f0804: 2023-07-20 15:11:40,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:11:40,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:11:40,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b. 2023-07-20 15:11:40,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ac199795930fd7d51d66c2ef34e1c81b: 2023-07-20 15:11:40,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a03cdb5071ecffe79d856ff7e26f0804 2023-07-20 15:11:40,161 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a03cdb5071ecffe79d856ff7e26f0804, regionState=CLOSED 2023-07-20 15:11:40,161 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865900161"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865900161"}]},"ts":"1689865900161"} 2023-07-20 15:11:40,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ac199795930fd7d51d66c2ef34e1c81b 2023-07-20 15:11:40,163 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ac199795930fd7d51d66c2ef34e1c81b, regionState=CLOSED 2023-07-20 15:11:40,163 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689865900163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865900163"}]},"ts":"1689865900163"} 2023-07-20 15:11:40,167 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-20 15:11:40,167 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure a03cdb5071ecffe79d856ff7e26f0804, server=jenkins-hbase4.apache.org,33243,1689865822788 in 187 msec 2023-07-20 15:11:40,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-20 15:11:40,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure ac199795930fd7d51d66c2ef34e1c81b, server=jenkins-hbase4.apache.org,40765,1689865822857 in 189 msec 2023-07-20 15:11:40,169 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a03cdb5071ecffe79d856ff7e26f0804, UNASSIGN in 210 msec 2023-07-20 15:11:40,172 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-20 15:11:40,172 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ac199795930fd7d51d66c2ef34e1c81b, UNASSIGN in 212 msec 2023-07-20 15:11:40,173 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865900173"}]},"ts":"1689865900173"} 2023-07-20 15:11:40,175 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-20 15:11:40,176 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-20 15:11:40,181 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 245 msec 2023-07-20 15:11:40,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-20 15:11:40,244 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-20 15:11:40,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-20 15:11:40,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 15:11:40,249 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 15:11:40,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-20 15:11:40,250 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 15:11:40,253 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40765] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-20 15:11:40,257 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804 2023-07-20 15:11:40,257 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b 2023-07-20 15:11:40,257 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 15:11:40,257 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 15:11:40,257 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 15:11:40,257 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 15:11:40,258 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 15:11:40,258 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 15:11:40,258 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 15:11:40,258 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-20 15:11:40,259 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 15:11:40,259 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 15:11:40,259 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 15:11:40,259 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:40,259 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:40,259 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-20 15:11:40,259 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:40,260 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:40,260 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804/cf, FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804/recovered.edits] 2023-07-20 15:11:40,261 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b/cf, FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b/recovered.edits] 2023-07-20 15:11:40,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-20 15:11:40,267 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804/cf/485e9f454ec04669a591b561d387479a to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804/cf/485e9f454ec04669a591b561d387479a 2023-07-20 15:11:40,267 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b/cf/d419df1bb8e74e41abb7ee525ec941cd to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b/cf/d419df1bb8e74e41abb7ee525ec941cd 2023-07-20 15:11:40,270 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804/recovered.edits/9.seqid to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804/recovered.edits/9.seqid 2023-07-20 15:11:40,271 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b/recovered.edits/9.seqid to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b/recovered.edits/9.seqid 2023-07-20 15:11:40,271 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/a03cdb5071ecffe79d856ff7e26f0804 2023-07-20 15:11:40,272 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testConsecutiveExports/ac199795930fd7d51d66c2ef34e1c81b 2023-07-20 15:11:40,272 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-20 15:11:40,274 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 15:11:40,282 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-20 15:11:40,289 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-20 15:11:40,291 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 15:11:40,291 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-20 15:11:40,291 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865900291"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:40,291 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865900291"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:40,295 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 15:11:40,296 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a03cdb5071ecffe79d856ff7e26f0804, NAME => 'testtb-testConsecutiveExports,,1689865866668.a03cdb5071ecffe79d856ff7e26f0804.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ac199795930fd7d51d66c2ef34e1c81b, NAME => 'testtb-testConsecutiveExports,1,1689865866668.ac199795930fd7d51d66c2ef34e1c81b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 15:11:40,296 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-20 15:11:40,296 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689865900296"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:40,300 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-20 15:11:40,303 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-20 15:11:40,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 58 msec 2023-07-20 15:11:40,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-20 15:11:40,362 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-20 15:11:40,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-20 15:11:40,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-20 15:11:40,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-20 15:11:40,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-20 15:11:40,418 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=747 (was 769), OpenFileDescriptor=892 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=434 (was 358) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=3285 (was 3169) - AvailableMemoryMB LEAK? - 2023-07-20 15:11:40,419 WARN [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-20 15:11:40,442 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=892, MaxFileDescriptor=60000, SystemLoadAverage=434, ProcessCount=185, AvailableMemoryMB=3275 2023-07-20 15:11:40,442 WARN [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-20 15:11:40,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 15:11:40,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:40,448 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:11:40,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-20 15:11:40,449 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:11:40,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 15:11:40,452 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929 2023-07-20 15:11:40,452 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b 2023-07-20 15:11:40,453 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929 empty. 2023-07-20 15:11:40,453 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b empty. 2023-07-20 15:11:40,453 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929 2023-07-20 15:11:40,453 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b 2023-07-20 15:11:40,453 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-20 15:11:40,474 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-20 15:11:40,476 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => f15c7dbef44cedb915a7bfb66b8b6929, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp 2023-07-20 15:11:40,476 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8952d120642b994eeca19eebc150060b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp 2023-07-20 15:11:40,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:40,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 8952d120642b994eeca19eebc150060b, disabling compactions & flushes 2023-07-20 15:11:40,512 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. 2023-07-20 15:11:40,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:40,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. 2023-07-20 15:11:40,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing f15c7dbef44cedb915a7bfb66b8b6929, disabling compactions & flushes 2023-07-20 15:11:40,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. after waiting 0 ms 2023-07-20 15:11:40,513 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. 2023-07-20 15:11:40,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. 2023-07-20 15:11:40,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. 2023-07-20 15:11:40,513 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. 2023-07-20 15:11:40,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. after waiting 0 ms 2023-07-20 15:11:40,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 8952d120642b994eeca19eebc150060b: 2023-07-20 15:11:40,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. 2023-07-20 15:11:40,513 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. 2023-07-20 15:11:40,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for f15c7dbef44cedb915a7bfb66b8b6929: 2023-07-20 15:11:40,516 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:11:40,517 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865900517"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865900517"}]},"ts":"1689865900517"} 2023-07-20 15:11:40,517 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865900517"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865900517"}]},"ts":"1689865900517"} 2023-07-20 15:11:40,526 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 15:11:40,527 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:11:40,527 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865900527"}]},"ts":"1689865900527"} 2023-07-20 15:11:40,529 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-20 15:11:40,534 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:11:40,535 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:11:40,536 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:11:40,536 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:11:40,536 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:11:40,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f15c7dbef44cedb915a7bfb66b8b6929, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8952d120642b994eeca19eebc150060b, ASSIGN}] 2023-07-20 15:11:40,539 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f15c7dbef44cedb915a7bfb66b8b6929, ASSIGN 2023-07-20 15:11:40,539 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8952d120642b994eeca19eebc150060b, ASSIGN 2023-07-20 15:11:40,540 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f15c7dbef44cedb915a7bfb66b8b6929, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45307,1689865822911; forceNewPlan=false, retain=false 2023-07-20 15:11:40,540 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8952d120642b994eeca19eebc150060b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40765,1689865822857; forceNewPlan=false, retain=false 2023-07-20 15:11:40,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 15:11:40,690 INFO [jenkins-hbase4:33245] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 15:11:40,694 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f15c7dbef44cedb915a7bfb66b8b6929, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:40,694 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=8952d120642b994eeca19eebc150060b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:40,695 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865900694"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865900694"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865900694"}]},"ts":"1689865900694"} 2023-07-20 15:11:40,695 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865900694"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865900694"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865900694"}]},"ts":"1689865900694"} 2023-07-20 15:11:40,700 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure f15c7dbef44cedb915a7bfb66b8b6929, server=jenkins-hbase4.apache.org,45307,1689865822911}] 2023-07-20 15:11:40,701 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 8952d120642b994eeca19eebc150060b, server=jenkins-hbase4.apache.org,40765,1689865822857}] 2023-07-20 15:11:40,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 15:11:40,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. 2023-07-20 15:11:40,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8952d120642b994eeca19eebc150060b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 15:11:40,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. service=AccessControlService 2023-07-20 15:11:40,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:11:40,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 8952d120642b994eeca19eebc150060b 2023-07-20 15:11:40,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:40,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8952d120642b994eeca19eebc150060b 2023-07-20 15:11:40,874 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8952d120642b994eeca19eebc150060b 2023-07-20 15:11:40,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. 2023-07-20 15:11:40,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f15c7dbef44cedb915a7bfb66b8b6929, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 15:11:40,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. service=AccessControlService 2023-07-20 15:11:40,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:11:40,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion f15c7dbef44cedb915a7bfb66b8b6929 2023-07-20 15:11:40,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:40,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f15c7dbef44cedb915a7bfb66b8b6929 2023-07-20 15:11:40,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f15c7dbef44cedb915a7bfb66b8b6929 2023-07-20 15:11:40,883 INFO [StoreOpener-8952d120642b994eeca19eebc150060b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8952d120642b994eeca19eebc150060b 2023-07-20 15:11:40,890 INFO [StoreOpener-f15c7dbef44cedb915a7bfb66b8b6929-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f15c7dbef44cedb915a7bfb66b8b6929 2023-07-20 15:11:40,891 DEBUG [StoreOpener-8952d120642b994eeca19eebc150060b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b/cf 2023-07-20 15:11:40,891 DEBUG [StoreOpener-8952d120642b994eeca19eebc150060b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b/cf 2023-07-20 15:11:40,892 DEBUG [StoreOpener-f15c7dbef44cedb915a7bfb66b8b6929-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929/cf 2023-07-20 15:11:40,892 DEBUG [StoreOpener-f15c7dbef44cedb915a7bfb66b8b6929-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929/cf 2023-07-20 15:11:40,892 INFO [StoreOpener-8952d120642b994eeca19eebc150060b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8952d120642b994eeca19eebc150060b columnFamilyName cf 2023-07-20 15:11:40,893 INFO [StoreOpener-f15c7dbef44cedb915a7bfb66b8b6929-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f15c7dbef44cedb915a7bfb66b8b6929 columnFamilyName cf 2023-07-20 15:11:40,893 INFO [StoreOpener-8952d120642b994eeca19eebc150060b-1] regionserver.HStore(310): Store=8952d120642b994eeca19eebc150060b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:11:40,894 INFO [StoreOpener-f15c7dbef44cedb915a7bfb66b8b6929-1] regionserver.HStore(310): Store=f15c7dbef44cedb915a7bfb66b8b6929/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:11:40,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b 2023-07-20 15:11:40,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929 2023-07-20 15:11:40,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b 2023-07-20 15:11:40,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929 2023-07-20 15:11:40,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f15c7dbef44cedb915a7bfb66b8b6929 2023-07-20 15:11:40,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8952d120642b994eeca19eebc150060b 2023-07-20 15:11:40,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:11:40,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:11:40,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f15c7dbef44cedb915a7bfb66b8b6929; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63148676, jitterRate=-0.05901139974594116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:11:40,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f15c7dbef44cedb915a7bfb66b8b6929: 2023-07-20 15:11:40,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8952d120642b994eeca19eebc150060b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59133963, jitterRate=-0.11883528530597687}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:11:40,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8952d120642b994eeca19eebc150060b: 2023-07-20 15:11:40,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929., pid=60, masterSystemTime=1689865900853 2023-07-20 15:11:40,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b., pid=61, masterSystemTime=1689865900854 2023-07-20 15:11:40,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. 2023-07-20 15:11:40,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. 2023-07-20 15:11:40,913 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f15c7dbef44cedb915a7bfb66b8b6929, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:40,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. 2023-07-20 15:11:40,913 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865900913"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865900913"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865900913"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865900913"}]},"ts":"1689865900913"} 2023-07-20 15:11:40,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. 2023-07-20 15:11:40,914 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=8952d120642b994eeca19eebc150060b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:40,914 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865900914"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865900914"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865900914"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865900914"}]},"ts":"1689865900914"} 2023-07-20 15:11:40,923 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-20 15:11:40,924 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure f15c7dbef44cedb915a7bfb66b8b6929, server=jenkins-hbase4.apache.org,45307,1689865822911 in 216 msec 2023-07-20 15:11:40,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-20 15:11:40,925 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 8952d120642b994eeca19eebc150060b, server=jenkins-hbase4.apache.org,40765,1689865822857 in 216 msec 2023-07-20 15:11:40,926 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f15c7dbef44cedb915a7bfb66b8b6929, ASSIGN in 388 msec 2023-07-20 15:11:40,928 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-20 15:11:40,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8952d120642b994eeca19eebc150060b, ASSIGN in 389 msec 2023-07-20 15:11:40,929 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:11:40,930 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865900929"}]},"ts":"1689865900929"} 2023-07-20 15:11:40,931 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-20 15:11:40,934 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:11:40,934 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-20 15:11:40,936 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40765] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 15:11:40,938 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:40,938 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:40,938 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:40,938 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:40,940 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:40,940 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:40,940 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:40,940 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:40,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 496 msec 2023-07-20 15:11:41,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-20 15:11:41,055 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-20 15:11:41,056 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-20 15:11:41,056 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:11:41,067 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-20 15:11:41,067 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:11:41,067 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-20 15:11:41,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 15:11:41,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865901100 (current time:1689865901100). 2023-07-20 15:11:41,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:11:41,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x59fbde7c to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:41,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d3de54a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:41,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:41,121 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:41,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59fbde7c to 127.0.0.1:60098 2023-07-20 15:11:41,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:41,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x3b5a0883 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:41,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cd539aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:41,141 DEBUG [hconnection-0x2e508ccf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:41,145 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:41,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b5a0883 to 127.0.0.1:60098 2023-07-20 15:11:41,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:41,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 15:11:41,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:11:41,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 15:11:41,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 15:11:41,162 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 15:11:41,163 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689866501163 2023-07-20 15:11:41,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 15:11:41,163 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,164 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:11:41,164 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:11:41,167 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 15:11:41,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 15:11:41,170 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 12 msec 2023-07-20 15:11:41,171 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 15:11:41,172 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689866501172 2023-07-20 15:11:41,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,191 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-20 15:11:41,191 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:41,193 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-20 15:11:41,193 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-20 15:11:41,194 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,194 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,195 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:41,195 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:41,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:41,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:41,195 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:41,195 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,197 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,197 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 15:11:41,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,198 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 15:11:41,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 15:11:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,199 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 15:11:41,199 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-20 15:11:41,199 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,199 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 15:11:41,199 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:41,199 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:11:41,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,200 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 15:11:41,202 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,204 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 15:11:41,205 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 15:11:41,205 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 15:11:41,205 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:41,205 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 15:11:41,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,208 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 15:11:41,208 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 15:11:41,208 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:41,208 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 15:11:41,210 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 15:11:41,210 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 15:11:41,208 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,210 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 15:11:41,210 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 15:11:41,210 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,210 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:41,211 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,211 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:41,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:41,216 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,223 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:41,223 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,223 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:41,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:41,224 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,224 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:41,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:41,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:41,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 15:11:41,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e1e337b[Count = 1] remaining members to acquire global barrier 2023-07-20 15:11:41,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:41,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:41,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:41,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:41,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:41,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:41,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 15:11:41,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e1e337b[Count = 0] remaining members to acquire global barrier 2023-07-20 15:11:41,228 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-20 15:11:41,228 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,231 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,231 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,231 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,231 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 15:11:41,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,231 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 15:11:41,231 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 15:11:41,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,232 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33243,1689865822788' in zk 2023-07-20 15:11:41,232 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 15:11:41,232 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,233 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,233 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:11:41,239 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 15:11:41,239 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:41,239 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 15:11:41,248 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:41,248 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:41,248 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. 2023-07-20 15:11:41,248 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. started... 2023-07-20 15:11:41,256 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:41,259 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. 2023-07-20 15:11:41,259 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:41,259 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. started... 2023-07-20 15:11:41,257 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f15c7dbef44cedb915a7bfb66b8b6929: 2023-07-20 15:11:41,261 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8952d120642b994eeca19eebc150060b: 2023-07-20 15:11:41,261 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,261 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,261 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:41,261 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:41,261 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:11:41,261 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:11:41,264 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:41,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 15:11:41,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:41,266 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:11:41,327 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. completed. 2023-07-20 15:11:41,327 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. 2023-07-20 15:11:41,327 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:41,327 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:41,327 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,327 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 15:11:41,327 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45307,1689865822911' in zk 2023-07-20 15:11:41,332 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 15:11:41,332 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:41,333 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 15:11:41,335 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. completed. 2023-07-20 15:11:41,335 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. 2023-07-20 15:11:41,335 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:41,335 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:41,335 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,335 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 15:11:41,335 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40765,1689865822857' in zk 2023-07-20 15:11:41,337 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 15:11:41,337 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:41,337 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 15:11:41,338 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,339 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:41,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:41,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:41,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:41,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:41,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:41,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:41,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45307,1689865822911': 2023-07-20 15:11:41,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-20 15:11:41,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:41,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:41,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:41,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:41,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:41,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:41,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:41,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40765,1689865822857': 2023-07-20 15:11:41,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-20 15:11:41,353 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-20 15:11:41,353 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:11:41,353 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:11:41,353 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,353 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:11:41,356 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,356 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:41,356 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,356 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:41,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,356 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:41,356 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,356 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:41,357 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:41,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:41,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:41,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:41,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:41,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,359 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:41,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:41,360 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:41,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:41,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,363 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,364 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:41,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:41,364 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,368 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,368 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,368 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:41,368 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:41,368 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:41,368 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:41,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:41,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:41,368 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:41,368 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:41,369 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:41,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:41,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:41,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:41,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:41,369 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,369 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:41,369 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,369 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:41,371 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:41,371 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:41,371 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:41,372 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:41,372 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:41,372 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,467 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:41,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 15:11:41,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:41,470 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 15:11:41,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,577 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-20 15:11:41,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,578 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689865901163Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689865901371 (+208 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689865901371Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689865901394 (+23 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689865901463 (+69 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689865901577 (+114 ms) 2023-07-20 15:11:41,580 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 15:11:41,582 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 415 msec 2023-07-20 15:11:41,770 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:41,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 15:11:41,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:11:41,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40765] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:11:41,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45307] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:11:41,811 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,812 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. 2023-07-20 15:11:41,812 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:11:41,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 15:11:41,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865901844 (current time:1689865901844). 2023-07-20 15:11:41,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:11:41,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x0df138d6 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:41,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78f031ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:41,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:41,871 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:41,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0df138d6 to 127.0.0.1:60098 2023-07-20 15:11:41,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:41,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x06bf09f9 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:41,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20ca670, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:41,911 DEBUG [hconnection-0x7b083a6a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:41,915 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:41,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06bf09f9 to 127.0.0.1:60098 2023-07-20 15:11:41,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:41,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-20 15:11:41,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:11:41,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 15:11:41,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 15:11:41,941 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 15:11:41,943 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689866501943 2023-07-20 15:11:41,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-20 15:11:41,943 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:41,944 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:11:41,944 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:11:41,947 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-20 15:11:41,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 15:11:41,949 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 20 msec 2023-07-20 15:11:41,950 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 15:11:41,951 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689866501951 2023-07-20 15:11:42,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,006 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-20 15:11:42,006 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:42,008 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-20 15:11:42,008 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-20 15:11:42,008 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,008 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,010 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:42,010 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:42,010 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:42,010 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:42,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:42,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:42,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:42,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:42,011 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:42,011 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,011 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,011 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:11:42,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 15:11:42,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 15:11:42,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 15:11:42,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 15:11:42,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-20 15:11:42,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,013 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-20 15:11:42,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,017 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 15:11:42,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,017 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,017 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:42,017 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 15:11:42,019 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:42,019 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 15:11:42,021 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 15:11:42,017 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-20 15:11:42,021 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 15:11:42,021 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 15:11:42,021 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 15:11:42,021 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 15:11:42,021 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:42,023 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-20 15:11:42,023 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-20 15:11:42,023 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-20 15:11:42,025 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,025 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:42,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:42,027 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,027 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,027 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,027 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:42,027 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:42,027 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,027 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,028 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:42,027 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:42,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:42,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 15:11:42,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25f9d5a7[Count = 1] remaining members to acquire global barrier 2023-07-20 15:11:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:42,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:42,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:42,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:42,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:42,044 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:42,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-20 15:11:42,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25f9d5a7[Count = 0] remaining members to acquire global barrier 2023-07-20 15:11:42,046 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-20 15:11:42,046 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 15:11:42,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:42,047 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:11:42,049 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,049 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,049 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 15:11:42,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,049 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,049 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 15:11:42,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,050 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:42,050 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:42,050 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. 2023-07-20 15:11:42,051 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. started... 2023-07-20 15:11:42,051 INFO [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f15c7dbef44cedb915a7bfb66b8b6929 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-20 15:11:42,051 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-20 15:11:42,050 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 15:11:42,051 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33243,1689865822788' in zk 2023-07-20 15:11:42,051 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,053 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:42,053 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:42,054 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. 2023-07-20 15:11:42,054 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. started... 2023-07-20 15:11:42,054 INFO [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8952d120642b994eeca19eebc150060b 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-20 15:11:42,055 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,055 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:11:42,055 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 15:11:42,055 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:42,055 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 15:11:42,111 INFO [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929/.tmp/cf/27331495ca704ccf92c873a0abe27a29 2023-07-20 15:11:42,134 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929/.tmp/cf/27331495ca704ccf92c873a0abe27a29 as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929/cf/27331495ca704ccf92c873a0abe27a29 2023-07-20 15:11:42,144 INFO [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929/cf/27331495ca704ccf92c873a0abe27a29, entries=3, sequenceid=6, filesize=5.0 K 2023-07-20 15:11:42,145 INFO [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for f15c7dbef44cedb915a7bfb66b8b6929 in 94ms, sequenceid=6, compaction requested=false 2023-07-20 15:11:42,145 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-20 15:11:42,146 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f15c7dbef44cedb915a7bfb66b8b6929: 2023-07-20 15:11:42,146 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,146 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:42,147 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929/cf/27331495ca704ccf92c873a0abe27a29] hfiles 2023-07-20 15:11:42,147 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929/cf/27331495ca704ccf92c873a0abe27a29 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,150 INFO [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b/.tmp/cf/fead116e729848d2bef78507a0932a46 2023-07-20 15:11:42,157 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b/.tmp/cf/fead116e729848d2bef78507a0932a46 as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b/cf/fead116e729848d2bef78507a0932a46 2023-07-20 15:11:42,168 INFO [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b/cf/fead116e729848d2bef78507a0932a46, entries=47, sequenceid=6, filesize=8 K 2023-07-20 15:11:42,172 INFO [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 8952d120642b994eeca19eebc150060b in 118ms, sequenceid=6, compaction requested=false 2023-07-20 15:11:42,174 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8952d120642b994eeca19eebc150060b: 2023-07-20 15:11:42,175 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,175 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:42,175 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b/cf/fead116e729848d2bef78507a0932a46] hfiles 2023-07-20 15:11:42,175 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b/cf/fead116e729848d2bef78507a0932a46 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,187 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. completed. 2023-07-20 15:11:42,188 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. 2023-07-20 15:11:42,188 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:42,188 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:42,188 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,188 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 15:11:42,188 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45307,1689865822911' in zk 2023-07-20 15:11:42,190 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 15:11:42,190 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,190 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:42,190 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 15:11:42,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:42,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:42,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:42,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:42,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:42,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45307,1689865822911': 2023-07-20 15:11:42,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-20 15:11:42,212 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. completed. 2023-07-20 15:11:42,212 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. 2023-07-20 15:11:42,212 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:42,212 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:42,212 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,212 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-20 15:11:42,212 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40765,1689865822857' in zk 2023-07-20 15:11:42,214 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-20 15:11:42,214 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,214 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:42,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:42,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:42,214 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-20 15:11:42,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:42,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:42,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:42,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:42,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:42,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40765,1689865822857': 2023-07-20 15:11:42,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-20 15:11:42,220 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-20 15:11:42,220 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:11:42,220 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:11:42,220 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,220 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:11:42,227 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,227 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,227 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,227 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:42,227 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,227 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:42,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,228 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:42,228 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:42,228 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,229 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:42,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:42,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:42,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:42,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:42,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:42,233 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,234 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:42,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,235 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,239 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:42,239 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:42,239 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:42,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:42,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:42,239 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:42,239 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:42,240 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,240 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,240 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:42,240 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:42,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:42,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:42,240 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:42,240 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:42,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:42,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:42,240 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,243 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,243 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:42,243 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:42,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:42,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:42,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:42,243 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:42,243 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,243 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,244 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,247 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:42,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 15:11:42,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:42,249 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 15:11:42,292 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,391 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-20 15:11:42,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,391 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:11:42,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689865901943Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689865902242 (+299 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689865902242Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689865902251 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689865902266 (+15 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689865902391 (+125 ms) 2023-07-20 15:11:42,395 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-20 15:11:42,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 450 msec 2023-07-20 15:11:42,549 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:42,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-20 15:11:42,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:11:42,588 DEBUG [Listener at jenkins-hbase4.apache.org/37809] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 15:11:42,592 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 15:11:42,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33243] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 15:11:42,595 DEBUG [Listener at jenkins-hbase4.apache.org/37809] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 15:11:42,601 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 15:11:42,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40765] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 15:11:42,602 DEBUG [Listener at jenkins-hbase4.apache.org/37809] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-20 15:11:42,608 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-20 15:11:42,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45307] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-20 15:11:42,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 15:11:42,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:42,619 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:11:42,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-20 15:11:42,620 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:11:42,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 15:11:42,623 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d 2023-07-20 15:11:42,630 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d empty. 2023-07-20 15:11:42,630 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf 2023-07-20 15:11:42,631 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d 2023-07-20 15:11:42,631 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf empty. 2023-07-20 15:11:42,632 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf 2023-07-20 15:11:42,632 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-20 15:11:42,654 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-20 15:11:42,656 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6dbbf14deea30457cae2035b2c39bf5d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp 2023-07-20 15:11:42,658 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9d596d7ddb046bbbdffe1cee9b36baaf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp 2023-07-20 15:11:42,702 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:42,702 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 9d596d7ddb046bbbdffe1cee9b36baaf, disabling compactions & flushes 2023-07-20 15:11:42,702 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf. 2023-07-20 15:11:42,702 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf. 2023-07-20 15:11:42,702 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf. after waiting 0 ms 2023-07-20 15:11:42,702 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf. 2023-07-20 15:11:42,702 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf. 2023-07-20 15:11:42,702 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 9d596d7ddb046bbbdffe1cee9b36baaf: 2023-07-20 15:11:42,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:42,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 6dbbf14deea30457cae2035b2c39bf5d, disabling compactions & flushes 2023-07-20 15:11:42,710 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d. 2023-07-20 15:11:42,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d. 2023-07-20 15:11:42,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d. after waiting 0 ms 2023-07-20 15:11:42,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d. 2023-07-20 15:11:42,710 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d. 2023-07-20 15:11:42,710 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 6dbbf14deea30457cae2035b2c39bf5d: 2023-07-20 15:11:42,713 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:11:42,715 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865902714"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865902714"}]},"ts":"1689865902714"} 2023-07-20 15:11:42,715 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865902714"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865902714"}]},"ts":"1689865902714"} 2023-07-20 15:11:42,717 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 15:11:42,718 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:11:42,718 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865902718"}]},"ts":"1689865902718"} 2023-07-20 15:11:42,720 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-20 15:11:42,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 15:11:42,742 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:11:42,743 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:11:42,743 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:11:42,743 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:11:42,743 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:11:42,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6dbbf14deea30457cae2035b2c39bf5d, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9d596d7ddb046bbbdffe1cee9b36baaf, ASSIGN}] 2023-07-20 15:11:42,746 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6dbbf14deea30457cae2035b2c39bf5d, ASSIGN 2023-07-20 15:11:42,746 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9d596d7ddb046bbbdffe1cee9b36baaf, ASSIGN 2023-07-20 15:11:42,747 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6dbbf14deea30457cae2035b2c39bf5d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40765,1689865822857; forceNewPlan=false, retain=false 2023-07-20 15:11:42,747 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9d596d7ddb046bbbdffe1cee9b36baaf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33243,1689865822788; forceNewPlan=false, retain=false 2023-07-20 15:11:42,897 INFO [jenkins-hbase4:33245] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 15:11:42,903 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9d596d7ddb046bbbdffe1cee9b36baaf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:42,903 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=6dbbf14deea30457cae2035b2c39bf5d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:42,903 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865902902"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865902902"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865902902"}]},"ts":"1689865902902"} 2023-07-20 15:11:42,903 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865902902"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865902902"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865902902"}]},"ts":"1689865902902"} 2023-07-20 15:11:42,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 6dbbf14deea30457cae2035b2c39bf5d, server=jenkins-hbase4.apache.org,40765,1689865822857}] 2023-07-20 15:11:42,907 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 9d596d7ddb046bbbdffe1cee9b36baaf, server=jenkins-hbase4.apache.org,33243,1689865822788}] 2023-07-20 15:11:42,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 15:11:43,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d. 2023-07-20 15:11:43,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6dbbf14deea30457cae2035b2c39bf5d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d.', STARTKEY => '', ENDKEY => '2'} 2023-07-20 15:11:43,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d. service=AccessControlService 2023-07-20 15:11:43,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf. 2023-07-20 15:11:43,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:11:43,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9d596d7ddb046bbbdffe1cee9b36baaf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf.', STARTKEY => '2', ENDKEY => ''} 2023-07-20 15:11:43,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6dbbf14deea30457cae2035b2c39bf5d 2023-07-20 15:11:43,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:43,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf. service=AccessControlService 2023-07-20 15:11:43,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6dbbf14deea30457cae2035b2c39bf5d 2023-07-20 15:11:43,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6dbbf14deea30457cae2035b2c39bf5d 2023-07-20 15:11:43,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:11:43,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 9d596d7ddb046bbbdffe1cee9b36baaf 2023-07-20 15:11:43,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:43,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9d596d7ddb046bbbdffe1cee9b36baaf 2023-07-20 15:11:43,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9d596d7ddb046bbbdffe1cee9b36baaf 2023-07-20 15:11:43,064 INFO [StoreOpener-6dbbf14deea30457cae2035b2c39bf5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6dbbf14deea30457cae2035b2c39bf5d 2023-07-20 15:11:43,066 INFO [StoreOpener-9d596d7ddb046bbbdffe1cee9b36baaf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9d596d7ddb046bbbdffe1cee9b36baaf 2023-07-20 15:11:43,066 DEBUG [StoreOpener-6dbbf14deea30457cae2035b2c39bf5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d/cf 2023-07-20 15:11:43,066 DEBUG [StoreOpener-6dbbf14deea30457cae2035b2c39bf5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d/cf 2023-07-20 15:11:43,067 INFO [StoreOpener-6dbbf14deea30457cae2035b2c39bf5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6dbbf14deea30457cae2035b2c39bf5d columnFamilyName cf 2023-07-20 15:11:43,067 DEBUG [StoreOpener-9d596d7ddb046bbbdffe1cee9b36baaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf/cf 2023-07-20 15:11:43,067 DEBUG [StoreOpener-9d596d7ddb046bbbdffe1cee9b36baaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf/cf 2023-07-20 15:11:43,068 INFO [StoreOpener-6dbbf14deea30457cae2035b2c39bf5d-1] regionserver.HStore(310): Store=6dbbf14deea30457cae2035b2c39bf5d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:11:43,068 INFO [StoreOpener-9d596d7ddb046bbbdffe1cee9b36baaf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d596d7ddb046bbbdffe1cee9b36baaf columnFamilyName cf 2023-07-20 15:11:43,068 INFO [StoreOpener-9d596d7ddb046bbbdffe1cee9b36baaf-1] regionserver.HStore(310): Store=9d596d7ddb046bbbdffe1cee9b36baaf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:11:43,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d 2023-07-20 15:11:43,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d 2023-07-20 15:11:43,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf 2023-07-20 15:11:43,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf 2023-07-20 15:11:43,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6dbbf14deea30457cae2035b2c39bf5d 2023-07-20 15:11:43,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9d596d7ddb046bbbdffe1cee9b36baaf 2023-07-20 15:11:43,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:11:43,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:11:43,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6dbbf14deea30457cae2035b2c39bf5d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73519835, jitterRate=0.0955309122800827}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:11:43,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9d596d7ddb046bbbdffe1cee9b36baaf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74303076, jitterRate=0.10720211267471313}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:11:43,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6dbbf14deea30457cae2035b2c39bf5d: 2023-07-20 15:11:43,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9d596d7ddb046bbbdffe1cee9b36baaf: 2023-07-20 15:11:43,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf., pid=70, masterSystemTime=1689865903059 2023-07-20 15:11:43,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d., pid=69, masterSystemTime=1689865903057 2023-07-20 15:11:43,080 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9d596d7ddb046bbbdffe1cee9b36baaf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:43,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d. 2023-07-20 15:11:43,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d. 2023-07-20 15:11:43,081 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865903080"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865903080"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865903080"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865903080"}]},"ts":"1689865903080"} 2023-07-20 15:11:43,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf. 2023-07-20 15:11:43,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf. 2023-07-20 15:11:43,081 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=6dbbf14deea30457cae2035b2c39bf5d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:43,081 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865903081"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865903081"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865903081"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865903081"}]},"ts":"1689865903081"} 2023-07-20 15:11:43,084 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-20 15:11:43,085 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 9d596d7ddb046bbbdffe1cee9b36baaf, server=jenkins-hbase4.apache.org,33243,1689865822788 in 175 msec 2023-07-20 15:11:43,086 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-20 15:11:43,086 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 6dbbf14deea30457cae2035b2c39bf5d, server=jenkins-hbase4.apache.org,40765,1689865822857 in 178 msec 2023-07-20 15:11:43,086 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9d596d7ddb046bbbdffe1cee9b36baaf, ASSIGN in 342 msec 2023-07-20 15:11:43,105 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-20 15:11:43,105 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6dbbf14deea30457cae2035b2c39bf5d, ASSIGN in 343 msec 2023-07-20 15:11:43,105 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:11:43,106 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865903106"}]},"ts":"1689865903106"} 2023-07-20 15:11:43,107 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-20 15:11:43,125 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:11:43,126 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-20 15:11:43,128 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40765] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-20 15:11:43,129 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:43,129 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:43,129 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:43,129 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:11:43,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:43,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:43,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:43,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:43,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:43,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:43,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:43,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-20 15:11:43,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 523 msec 2023-07-20 15:11:43,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-20 15:11:43,224 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-20 15:11:43,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 6dbbf14deea30457cae2035b2c39bf5d, 9d596d7ddb046bbbdffe1cee9b36baaf 2023-07-20 15:11:43,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6dbbf14deea30457cae2035b2c39bf5d, 9d596d7ddb046bbbdffe1cee9b36baaf], force=true 2023-07-20 15:11:43,259 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6dbbf14deea30457cae2035b2c39bf5d, 9d596d7ddb046bbbdffe1cee9b36baaf], force=true 2023-07-20 15:11:43,259 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6dbbf14deea30457cae2035b2c39bf5d, 9d596d7ddb046bbbdffe1cee9b36baaf], force=true 2023-07-20 15:11:43,259 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6dbbf14deea30457cae2035b2c39bf5d, 9d596d7ddb046bbbdffe1cee9b36baaf], force=true 2023-07-20 15:11:43,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 15:11:43,281 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6dbbf14deea30457cae2035b2c39bf5d, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9d596d7ddb046bbbdffe1cee9b36baaf, UNASSIGN}] 2023-07-20 15:11:43,283 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6dbbf14deea30457cae2035b2c39bf5d, UNASSIGN 2023-07-20 15:11:43,283 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9d596d7ddb046bbbdffe1cee9b36baaf, UNASSIGN 2023-07-20 15:11:43,284 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=6dbbf14deea30457cae2035b2c39bf5d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:43,284 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9d596d7ddb046bbbdffe1cee9b36baaf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:43,284 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865903284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865903284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865903284"}]},"ts":"1689865903284"} 2023-07-20 15:11:43,284 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865903284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865903284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865903284"}]},"ts":"1689865903284"} 2023-07-20 15:11:43,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 6dbbf14deea30457cae2035b2c39bf5d, server=jenkins-hbase4.apache.org,40765,1689865822857}] 2023-07-20 15:11:43,286 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 9d596d7ddb046bbbdffe1cee9b36baaf, server=jenkins-hbase4.apache.org,33243,1689865822788}] 2023-07-20 15:11:43,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 15:11:43,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6dbbf14deea30457cae2035b2c39bf5d 2023-07-20 15:11:43,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6dbbf14deea30457cae2035b2c39bf5d, disabling compactions & flushes 2023-07-20 15:11:43,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d. 2023-07-20 15:11:43,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d. 2023-07-20 15:11:43,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d. after waiting 0 ms 2023-07-20 15:11:43,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d. 2023-07-20 15:11:43,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6dbbf14deea30457cae2035b2c39bf5d 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-20 15:11:43,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9d596d7ddb046bbbdffe1cee9b36baaf 2023-07-20 15:11:43,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9d596d7ddb046bbbdffe1cee9b36baaf, disabling compactions & flushes 2023-07-20 15:11:43,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf. 2023-07-20 15:11:43,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf. 2023-07-20 15:11:43,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf. after waiting 0 ms 2023-07-20 15:11:43,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf. 2023-07-20 15:11:43,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9d596d7ddb046bbbdffe1cee9b36baaf 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-20 15:11:43,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d/.tmp/cf/99d1a9c7fb9a4138b64b7e65eb6d9cd2 2023-07-20 15:11:43,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d/.tmp/cf/99d1a9c7fb9a4138b64b7e65eb6d9cd2 as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d/cf/99d1a9c7fb9a4138b64b7e65eb6d9cd2 2023-07-20 15:11:43,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d/cf/99d1a9c7fb9a4138b64b7e65eb6d9cd2, entries=1, sequenceid=5, filesize=4.7 K 2023-07-20 15:11:43,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 6dbbf14deea30457cae2035b2c39bf5d in 44ms, sequenceid=5, compaction requested=false 2023-07-20 15:11:43,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-20 15:11:43,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-20 15:11:43,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:11:43,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d. 2023-07-20 15:11:43,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6dbbf14deea30457cae2035b2c39bf5d: 2023-07-20 15:11:43,496 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6dbbf14deea30457cae2035b2c39bf5d 2023-07-20 15:11:43,496 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=6dbbf14deea30457cae2035b2c39bf5d, regionState=CLOSED 2023-07-20 15:11:43,497 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865903496"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865903496"}]},"ts":"1689865903496"} 2023-07-20 15:11:43,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-20 15:11:43,502 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 6dbbf14deea30457cae2035b2c39bf5d, server=jenkins-hbase4.apache.org,40765,1689865822857 in 213 msec 2023-07-20 15:11:43,503 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6dbbf14deea30457cae2035b2c39bf5d, UNASSIGN in 224 msec 2023-07-20 15:11:43,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 15:11:43,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 15:11:43,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf/.tmp/cf/5019c418fbb648b596955a303e9258ce 2023-07-20 15:11:43,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf/.tmp/cf/5019c418fbb648b596955a303e9258ce as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf/cf/5019c418fbb648b596955a303e9258ce 2023-07-20 15:11:43,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf/cf/5019c418fbb648b596955a303e9258ce, entries=1, sequenceid=5, filesize=4.7 K 2023-07-20 15:11:43,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 9d596d7ddb046bbbdffe1cee9b36baaf in 437ms, sequenceid=5, compaction requested=false 2023-07-20 15:11:43,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-20 15:11:43,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:11:43,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf. 2023-07-20 15:11:43,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9d596d7ddb046bbbdffe1cee9b36baaf: 2023-07-20 15:11:43,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9d596d7ddb046bbbdffe1cee9b36baaf 2023-07-20 15:11:43,892 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9d596d7ddb046bbbdffe1cee9b36baaf, regionState=CLOSED 2023-07-20 15:11:43,892 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689865903892"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865903892"}]},"ts":"1689865903892"} 2023-07-20 15:11:43,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-20 15:11:43,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 9d596d7ddb046bbbdffe1cee9b36baaf, server=jenkins-hbase4.apache.org,33243,1689865822788 in 607 msec 2023-07-20 15:11:43,896 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-20 15:11:43,896 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9d596d7ddb046bbbdffe1cee9b36baaf, UNASSIGN in 614 msec 2023-07-20 15:11:43,945 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-20 15:11:43,947 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902611.6dbbf14deea30457cae2035b2c39bf5d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:43,947 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689865902611.9d596d7ddb046bbbdffe1cee9b36baaf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:43,947 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-20 15:11:44,001 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a18df7a69355e6b315dac44539774e1, ASSIGN}] 2023-07-20 15:11:44,002 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a18df7a69355e6b315dac44539774e1, ASSIGN 2023-07-20 15:11:44,003 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a18df7a69355e6b315dac44539774e1, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,40765,1689865822857; forceNewPlan=false, retain=false 2023-07-20 15:11:44,153 INFO [jenkins-hbase4:33245] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-20 15:11:44,155 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4a18df7a69355e6b315dac44539774e1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:44,155 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689865904155"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865904155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865904155"}]},"ts":"1689865904155"} 2023-07-20 15:11:44,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 4a18df7a69355e6b315dac44539774e1, server=jenkins-hbase4.apache.org,40765,1689865822857}] 2023-07-20 15:11:44,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1. 2023-07-20 15:11:44,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a18df7a69355e6b315dac44539774e1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1.', STARTKEY => '', ENDKEY => ''} 2023-07-20 15:11:44,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1. service=AccessControlService 2023-07-20 15:11:44,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:11:44,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4a18df7a69355e6b315dac44539774e1 2023-07-20 15:11:44,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:11:44,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4a18df7a69355e6b315dac44539774e1 2023-07-20 15:11:44,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4a18df7a69355e6b315dac44539774e1 2023-07-20 15:11:44,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/.regioninfo 2023-07-20 15:11:44,327 INFO [StoreOpener-4a18df7a69355e6b315dac44539774e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4a18df7a69355e6b315dac44539774e1 2023-07-20 15:11:44,328 DEBUG [StoreOpener-4a18df7a69355e6b315dac44539774e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/cf 2023-07-20 15:11:44,328 DEBUG [StoreOpener-4a18df7a69355e6b315dac44539774e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/cf 2023-07-20 15:11:44,328 INFO [StoreOpener-4a18df7a69355e6b315dac44539774e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a18df7a69355e6b315dac44539774e1 columnFamilyName cf 2023-07-20 15:11:44,360 DEBUG [StoreOpener-4a18df7a69355e6b315dac44539774e1-1] regionserver.HStore(539): loaded hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/cf/5019c418fbb648b596955a303e9258ce.9d596d7ddb046bbbdffe1cee9b36baaf->hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf/cf/5019c418fbb648b596955a303e9258ce-top 2023-07-20 15:11:44,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 15:11:44,375 DEBUG [StoreOpener-4a18df7a69355e6b315dac44539774e1-1] regionserver.HStore(539): loaded hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/cf/99d1a9c7fb9a4138b64b7e65eb6d9cd2.6dbbf14deea30457cae2035b2c39bf5d->hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d/cf/99d1a9c7fb9a4138b64b7e65eb6d9cd2-top 2023-07-20 15:11:44,376 INFO [StoreOpener-4a18df7a69355e6b315dac44539774e1-1] regionserver.HStore(310): Store=4a18df7a69355e6b315dac44539774e1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:11:44,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1 2023-07-20 15:11:44,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1 2023-07-20 15:11:44,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4a18df7a69355e6b315dac44539774e1 2023-07-20 15:11:44,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4a18df7a69355e6b315dac44539774e1; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66397746, jitterRate=-0.010596483945846558}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:11:44,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4a18df7a69355e6b315dac44539774e1: 2023-07-20 15:11:44,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1., pid=77, masterSystemTime=1689865904309 2023-07-20 15:11:44,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1.,because compaction is disabled. 2023-07-20 15:11:44,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1. 2023-07-20 15:11:44,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1. 2023-07-20 15:11:44,390 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4a18df7a69355e6b315dac44539774e1, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:44,391 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689865904390"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865904390"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865904390"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865904390"}]},"ts":"1689865904390"} 2023-07-20 15:11:44,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-20 15:11:44,394 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 4a18df7a69355e6b315dac44539774e1, server=jenkins-hbase4.apache.org,40765,1689865822857 in 235 msec 2023-07-20 15:11:44,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-20 15:11:44,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a18df7a69355e6b315dac44539774e1, ASSIGN in 393 msec 2023-07-20 15:11:44,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6dbbf14deea30457cae2035b2c39bf5d, 9d596d7ddb046bbbdffe1cee9b36baaf], force=true in 1.1430 sec 2023-07-20 15:11:44,621 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0004_000001 (auth:SIMPLE) 2023-07-20 15:11:45,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-20 15:11:45,370 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-20 15:11:45,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 15:11:45,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865905371 (current time:1689865905371). 2023-07-20 15:11:45,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:11:45,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x37e9f146 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:45,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74469813, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:45,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:45,382 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:45,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37e9f146 to 127.0.0.1:60098 2023-07-20 15:11:45,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:45,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x39a1573b to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:11:45,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@413ae288, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:11:45,395 DEBUG [hconnection-0x1fc6cbc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:11:45,398 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60324, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:11:45,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39a1573b to 127.0.0.1:60098 2023-07-20 15:11:45,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:11:45,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-20 15:11:45,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:11:45,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 15:11:45,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 15:11:45,410 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 15:11:45,410 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689866505410 2023-07-20 15:11:45,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-20 15:11:45,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,414 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:11:45,414 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:11:45,415 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-20 15:11:45,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 15:11:45,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-20 15:11:45,420 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 15:11:45,420 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689866505420 2023-07-20 15:11:45,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,439 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-20 15:11:45,439 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:45,441 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-20 15:11:45,441 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-20 15:11:45,441 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,441 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,442 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:45,443 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:45,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:45,443 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:45,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,443 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:45,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,443 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:45,443 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:11:45,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:45,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 15:11:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 15:11:45,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,445 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 15:11:45,445 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 15:11:45,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,445 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 15:11:45,445 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:45,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-20 15:11:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 15:11:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 15:11:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 15:11:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,449 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 15:11:45,449 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 15:11:45,449 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-20 15:11:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 15:11:45,449 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 15:11:45,449 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,449 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-20 15:11:45,449 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:11:45,450 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-20 15:11:45,450 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-20 15:11:45,451 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-20 15:11:45,452 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,452 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,454 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:45,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:45,454 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,454 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,454 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:45,454 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,454 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:45,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:45,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:45,454 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,454 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:11:45,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:45,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:45,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:45,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:45,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:45,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:45,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-20 15:11:45,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19f23b09[Count = 0] remaining members to acquire global barrier 2023-07-20 15:11:45,457 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-20 15:11:45,457 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,458 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,458 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,458 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 15:11:45,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 15:11:45,459 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:45,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,459 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:11:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 15:11:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33243,1689865822788' in zk 2023-07-20 15:11:45,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-20 15:11:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 15:11:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45307,1689865822911' in zk 2023-07-20 15:11:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:11:45,459 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:11:45,459 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1. 2023-07-20 15:11:45,459 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1. started... 2023-07-20 15:11:45,461 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4a18df7a69355e6b315dac44539774e1: 2023-07-20 15:11:45,461 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,461 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:11:45,461 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/cf/5019c418fbb648b596955a303e9258ce.9d596d7ddb046bbbdffe1cee9b36baaf->hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf/cf/5019c418fbb648b596955a303e9258ce-top, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/cf/99d1a9c7fb9a4138b64b7e65eb6d9cd2.6dbbf14deea30457cae2035b2c39bf5d->hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d/cf/99d1a9c7fb9a4138b64b7e65eb6d9cd2-top] hfiles 2023-07-20 15:11:45,461 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/cf/5019c418fbb648b596955a303e9258ce.9d596d7ddb046bbbdffe1cee9b36baaf for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,462 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 15:11:45,462 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/cf/99d1a9c7fb9a4138b64b7e65eb6d9cd2.6dbbf14deea30457cae2035b2c39bf5d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,462 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:45,462 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 15:11:45,463 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 15:11:45,463 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:45,463 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 15:11:45,475 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1. completed. 2023-07-20 15:11:45,475 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1. 2023-07-20 15:11:45,476 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:11:45,476 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:11:45,476 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:45,476 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-20 15:11:45,476 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40765,1689865822857' in zk 2023-07-20 15:11:45,481 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-20 15:11:45,481 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:45,481 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:45,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:45,481 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-20 15:11:45,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:45,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:45,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:45,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:45,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:45,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:45,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:45,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:45,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,40765,1689865822857': 2023-07-20 15:11:45,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-20 15:11:45,485 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-20 15:11:45,485 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:11:45,486 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:11:45,486 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,486 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:11:45,487 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,488 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:45,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,488 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,488 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,489 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:11:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:11:45,488 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,490 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:45,490 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:45,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:45,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:11:45,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:45,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:45,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,491 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:45,492 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:45,494 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:45,494 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:45,495 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:45,498 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:45,498 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:45,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:45,499 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:45,499 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:11:45,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,499 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:45,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,499 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,499 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:45,499 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:45,499 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,499 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:11:45,499 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,499 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:11:45,499 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:45,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:45,499 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:11:45,499 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:45,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,499 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:11:45,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:11:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:11:45,499 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:11:45,499 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:45,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:45,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:11:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:11:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:11:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:11:45,502 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-20 15:11:45,514 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:45,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-20 15:11:45,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:11:45,516 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:11:45,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,570 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-20 15:11:45,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,570 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689865905411Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689865905499 (+88 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689865905499Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689865905503 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689865905517 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689865905570 (+53 ms) 2023-07-20 15:11:45,574 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-20 15:11:45,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 160 msec 2023-07-20 15:11:45,716 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:11:45,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-20 15:11:45,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:11:45,718 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865905718 2023-07-20 15:11:45,718 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34279, tgtDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865905718, rawTgtDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865905718, srcFsUri=hdfs://localhost:34279, srcDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:11:45,750 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34279, inputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:11:45,750 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1462930784_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865905718, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865905718/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,750 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34279, inputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84, snapshotDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-20 15:11:45,768 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865905718/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:11:45,799 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 15:11:45,877 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:45,878 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:45,878 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:45,879 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:45,879 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:45,880 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:45,880 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,000 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/hadoop-4375559170278509389.jar 2023-07-20 15:11:46,001 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,001 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,002 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,002 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,003 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,003 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 15:11:46,004 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 15:11:46,004 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 15:11:46,005 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 15:11:46,005 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 15:11:46,006 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 15:11:46,007 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 15:11:46,007 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 15:11:46,008 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 15:11:46,008 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 15:11:46,009 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 15:11:46,009 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:46,010 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:46,010 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:46,011 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:46,011 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:11:46,011 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:46,012 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:11:47,115 WARN [Listener at jenkins-hbase4.apache.org/37809] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 15:11:47,118 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-20 15:11:47,120 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-20 15:11:47,188 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:11:47,188 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:11:47,628 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0005_000001 (auth:SIMPLE) 2023-07-20 15:11:53,603 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0005_000001 (auth:SIMPLE) 2023-07-20 15:11:55,952 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0005_000001 (auth:SIMPLE) 2023-07-20 15:12:02,420 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 15:12:02,427 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 15:12:02,436 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,436 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 15:12:02,437 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 15:12:02,437 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-201645114_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,437 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-20 15:12:02,437 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-20 15:12:02,438 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-201645114_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865905718/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865905718/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,438 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865905718/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-20 15:12:02,438 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865905718/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-20 15:12:02,446 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 15:12:02,465 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865922465"}]},"ts":"1689865922465"} 2023-07-20 15:12:02,466 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-20 15:12:02,468 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-20 15:12:02,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a18df7a69355e6b315dac44539774e1, UNASSIGN}] 2023-07-20 15:12:02,470 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a18df7a69355e6b315dac44539774e1, UNASSIGN 2023-07-20 15:12:02,471 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4a18df7a69355e6b315dac44539774e1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:02,471 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689865922471"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865922471"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865922471"}]},"ts":"1689865922471"} 2023-07-20 15:12:02,472 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 4a18df7a69355e6b315dac44539774e1, server=jenkins-hbase4.apache.org,40765,1689865822857}] 2023-07-20 15:12:02,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 15:12:02,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4a18df7a69355e6b315dac44539774e1 2023-07-20 15:12:02,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4a18df7a69355e6b315dac44539774e1, disabling compactions & flushes 2023-07-20 15:12:02,625 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1. 2023-07-20 15:12:02,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1. 2023-07-20 15:12:02,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1. after waiting 0 ms 2023-07-20 15:12:02,625 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1. 2023-07-20 15:12:02,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-20 15:12:02,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:12:02,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1. 2023-07-20 15:12:02,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4a18df7a69355e6b315dac44539774e1: 2023-07-20 15:12:02,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4a18df7a69355e6b315dac44539774e1 2023-07-20 15:12:02,643 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4a18df7a69355e6b315dac44539774e1, regionState=CLOSED 2023-07-20 15:12:02,643 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689865922643"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865922643"}]},"ts":"1689865922643"} 2023-07-20 15:12:02,648 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-20 15:12:02,648 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 4a18df7a69355e6b315dac44539774e1, server=jenkins-hbase4.apache.org,40765,1689865822857 in 173 msec 2023-07-20 15:12:02,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-20 15:12:02,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4a18df7a69355e6b315dac44539774e1, UNASSIGN in 179 msec 2023-07-20 15:12:02,650 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865922650"}]},"ts":"1689865922650"} 2023-07-20 15:12:02,659 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-20 15:12:02,661 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-20 15:12:02,664 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 216 msec 2023-07-20 15:12:02,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-20 15:12:02,762 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-20 15:12:02,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,767 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,768 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,770 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40765] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,774 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,774 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,774 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,774 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 15:12:02,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 15:12:02,775 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-20 15:12:02,776 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,776 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,776 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:02,777 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,777 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:02,776 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:02,777 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:02,778 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:02,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:02,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-20 15:12:02,779 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:02,783 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-20 15:12:02,783 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-20 15:12:02,783 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:02,788 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1 2023-07-20 15:12:02,791 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf 2023-07-20 15:12:02,792 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d 2023-07-20 15:12:02,793 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf/cf, FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf/recovered.edits] 2023-07-20 15:12:02,793 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/cf, FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/recovered.edits] 2023-07-20 15:12:02,797 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d/cf, FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d/recovered.edits] 2023-07-20 15:12:02,805 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf/cf/5019c418fbb648b596955a303e9258ce to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf/cf/5019c418fbb648b596955a303e9258ce 2023-07-20 15:12:02,806 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/cf/5019c418fbb648b596955a303e9258ce.9d596d7ddb046bbbdffe1cee9b36baaf to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/cf/5019c418fbb648b596955a303e9258ce.9d596d7ddb046bbbdffe1cee9b36baaf 2023-07-20 15:12:02,809 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/cf/99d1a9c7fb9a4138b64b7e65eb6d9cd2.6dbbf14deea30457cae2035b2c39bf5d to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/cf/99d1a9c7fb9a4138b64b7e65eb6d9cd2.6dbbf14deea30457cae2035b2c39bf5d 2023-07-20 15:12:02,810 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d/cf/99d1a9c7fb9a4138b64b7e65eb6d9cd2 to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d/cf/99d1a9c7fb9a4138b64b7e65eb6d9cd2 2023-07-20 15:12:02,812 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf/recovered.edits/8.seqid to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf/recovered.edits/8.seqid 2023-07-20 15:12:02,813 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9d596d7ddb046bbbdffe1cee9b36baaf 2023-07-20 15:12:02,815 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/recovered.edits/12.seqid to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1/recovered.edits/12.seqid 2023-07-20 15:12:02,815 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4a18df7a69355e6b315dac44539774e1 2023-07-20 15:12:02,817 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d/recovered.edits/8.seqid to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d/recovered.edits/8.seqid 2023-07-20 15:12:02,818 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbbf14deea30457cae2035b2c39bf5d 2023-07-20 15:12:02,818 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-20 15:12:02,821 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,828 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-20 15:12:02,832 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-20 15:12:02,833 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,833 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-20 15:12:02,834 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865922833"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:02,839 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-20 15:12:02,839 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4a18df7a69355e6b315dac44539774e1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689865902612.4a18df7a69355e6b315dac44539774e1.', STARTKEY => '', ENDKEY => ''}] 2023-07-20 15:12:02,839 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-20 15:12:02,839 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689865922839"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:02,844 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-20 15:12:02,846 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:02,848 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 83 msec 2023-07-20 15:12:02,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-20 15:12:02,880 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-20 15:12:02,881 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:02,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 15:12:02,887 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865922887"}]},"ts":"1689865922887"} 2023-07-20 15:12:02,889 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-20 15:12:02,891 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-20 15:12:02,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f15c7dbef44cedb915a7bfb66b8b6929, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8952d120642b994eeca19eebc150060b, UNASSIGN}] 2023-07-20 15:12:02,899 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8952d120642b994eeca19eebc150060b, UNASSIGN 2023-07-20 15:12:02,900 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f15c7dbef44cedb915a7bfb66b8b6929, UNASSIGN 2023-07-20 15:12:02,901 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=8952d120642b994eeca19eebc150060b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:02,901 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865922901"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865922901"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865922901"}]},"ts":"1689865922901"} 2023-07-20 15:12:02,902 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f15c7dbef44cedb915a7bfb66b8b6929, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:02,902 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865922902"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865922902"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865922902"}]},"ts":"1689865922902"} 2023-07-20 15:12:02,903 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 8952d120642b994eeca19eebc150060b, server=jenkins-hbase4.apache.org,40765,1689865822857}] 2023-07-20 15:12:02,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure f15c7dbef44cedb915a7bfb66b8b6929, server=jenkins-hbase4.apache.org,45307,1689865822911}] 2023-07-20 15:12:02,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 15:12:03,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8952d120642b994eeca19eebc150060b 2023-07-20 15:12:03,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8952d120642b994eeca19eebc150060b, disabling compactions & flushes 2023-07-20 15:12:03,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. 2023-07-20 15:12:03,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. 2023-07-20 15:12:03,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. after waiting 0 ms 2023-07-20 15:12:03,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. 2023-07-20 15:12:03,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f15c7dbef44cedb915a7bfb66b8b6929 2023-07-20 15:12:03,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f15c7dbef44cedb915a7bfb66b8b6929, disabling compactions & flushes 2023-07-20 15:12:03,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. 2023-07-20 15:12:03,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. 2023-07-20 15:12:03,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. after waiting 0 ms 2023-07-20 15:12:03,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. 2023-07-20 15:12:03,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:12:03,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:12:03,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:12:03,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b. 2023-07-20 15:12:03,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8952d120642b994eeca19eebc150060b: 2023-07-20 15:12:03,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:12:03,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929. 2023-07-20 15:12:03,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f15c7dbef44cedb915a7bfb66b8b6929: 2023-07-20 15:12:03,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8952d120642b994eeca19eebc150060b 2023-07-20 15:12:03,132 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=8952d120642b994eeca19eebc150060b, regionState=CLOSED 2023-07-20 15:12:03,132 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865923132"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865923132"}]},"ts":"1689865923132"} 2023-07-20 15:12:03,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f15c7dbef44cedb915a7bfb66b8b6929 2023-07-20 15:12:03,139 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f15c7dbef44cedb915a7bfb66b8b6929, regionState=CLOSED 2023-07-20 15:12:03,140 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689865923139"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865923139"}]},"ts":"1689865923139"} 2023-07-20 15:12:03,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-20 15:12:03,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-20 15:12:03,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 8952d120642b994eeca19eebc150060b, server=jenkins-hbase4.apache.org,40765,1689865822857 in 237 msec 2023-07-20 15:12:03,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure f15c7dbef44cedb915a7bfb66b8b6929, server=jenkins-hbase4.apache.org,45307,1689865822911 in 237 msec 2023-07-20 15:12:03,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8952d120642b994eeca19eebc150060b, UNASSIGN in 262 msec 2023-07-20 15:12:03,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-20 15:12:03,157 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f15c7dbef44cedb915a7bfb66b8b6929, UNASSIGN in 262 msec 2023-07-20 15:12:03,159 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865923159"}]},"ts":"1689865923159"} 2023-07-20 15:12:03,162 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-20 15:12:03,166 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-20 15:12:03,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 288 msec 2023-07-20 15:12:03,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-20 15:12:03,191 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-20 15:12:03,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,202 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,203 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,205 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40765] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,208 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,208 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,208 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,208 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,210 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 15:12:03,210 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 15:12:03,210 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 15:12:03,210 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-20 15:12:03,210 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b 2023-07-20 15:12:03,210 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929 2023-07-20 15:12:03,212 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,212 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:03,212 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,213 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,213 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:03,213 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:03,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-20 15:12:03,215 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,215 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:03,216 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b/cf, FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b/recovered.edits] 2023-07-20 15:12:03,216 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929/cf, FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929/recovered.edits] 2023-07-20 15:12:03,220 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929/cf/27331495ca704ccf92c873a0abe27a29 to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929/cf/27331495ca704ccf92c873a0abe27a29 2023-07-20 15:12:03,220 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b/cf/fead116e729848d2bef78507a0932a46 to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b/cf/fead116e729848d2bef78507a0932a46 2023-07-20 15:12:03,223 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929/recovered.edits/9.seqid to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929/recovered.edits/9.seqid 2023-07-20 15:12:03,224 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b/recovered.edits/9.seqid to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b/recovered.edits/9.seqid 2023-07-20 15:12:03,224 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f15c7dbef44cedb915a7bfb66b8b6929 2023-07-20 15:12:03,224 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8952d120642b994eeca19eebc150060b 2023-07-20 15:12:03,225 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-20 15:12:03,229 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,231 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-20 15:12:03,234 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-20 15:12:03,235 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,235 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-20 15:12:03,235 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865923235"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:03,235 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865923235"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:03,237 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 15:12:03,237 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f15c7dbef44cedb915a7bfb66b8b6929, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689865900444.f15c7dbef44cedb915a7bfb66b8b6929.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8952d120642b994eeca19eebc150060b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689865900444.8952d120642b994eeca19eebc150060b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 15:12:03,237 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-20 15:12:03,237 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689865923237"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:03,239 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-20 15:12:03,241 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 43 msec 2023-07-20 15:12:03,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-20 15:12:03,315 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-20 15:12:03,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-20 15:12:03,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-20 15:12:03,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-20 15:12:03,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-20 15:12:03,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-20 15:12:03,377 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 747) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:34609 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-3831 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-201645114_17 at /127.0.0.1:46482 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1167934253_1 at /127.0.0.1:55760 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-201645114_17 at /127.0.0.1:55790 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-201645114_17 at /127.0.0.1:40574 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1167934253_1 at /127.0.0.1:40556 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:35779 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=917 (was 892) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=562 (was 434) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 185), AvailableMemoryMB=2721 (was 3275) 2023-07-20 15:12:03,377 WARN [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-20 15:12:03,404 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=917, MaxFileDescriptor=60000, SystemLoadAverage=562, ProcessCount=185, AvailableMemoryMB=2717 2023-07-20 15:12:03,404 WARN [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-20 15:12:03,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 15:12:03,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 15:12:03,412 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:12:03,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-20 15:12:03,413 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:12:03,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 15:12:03,415 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498 2023-07-20 15:12:03,415 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc 2023-07-20 15:12:03,416 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498 empty. 2023-07-20 15:12:03,416 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc empty. 2023-07-20 15:12:03,416 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498 2023-07-20 15:12:03,416 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc 2023-07-20 15:12:03,417 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-20 15:12:03,432 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-20 15:12:03,434 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 587bffd214e16f85fbb7ee56563ff498, NAME => 'testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp 2023-07-20 15:12:03,434 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 070a19af44cc6d832d86737a466fc9cc, NAME => 'testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp 2023-07-20 15:12:03,450 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:12:03,450 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 070a19af44cc6d832d86737a466fc9cc, disabling compactions & flushes 2023-07-20 15:12:03,450 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. 2023-07-20 15:12:03,450 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. 2023-07-20 15:12:03,450 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. after waiting 0 ms 2023-07-20 15:12:03,450 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. 2023-07-20 15:12:03,450 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. 2023-07-20 15:12:03,450 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 070a19af44cc6d832d86737a466fc9cc: 2023-07-20 15:12:03,454 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:12:03,454 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 587bffd214e16f85fbb7ee56563ff498, disabling compactions & flushes 2023-07-20 15:12:03,454 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. 2023-07-20 15:12:03,454 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. 2023-07-20 15:12:03,454 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. after waiting 0 ms 2023-07-20 15:12:03,454 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. 2023-07-20 15:12:03,454 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. 2023-07-20 15:12:03,454 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 587bffd214e16f85fbb7ee56563ff498: 2023-07-20 15:12:03,460 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:12:03,461 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865923461"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865923461"}]},"ts":"1689865923461"} 2023-07-20 15:12:03,461 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865923461"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865923461"}]},"ts":"1689865923461"} 2023-07-20 15:12:03,464 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 15:12:03,465 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:12:03,465 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865923465"}]},"ts":"1689865923465"} 2023-07-20 15:12:03,467 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-20 15:12:03,471 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:12:03,472 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:12:03,472 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:12:03,472 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:12:03,472 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:12:03,472 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=070a19af44cc6d832d86737a466fc9cc, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=587bffd214e16f85fbb7ee56563ff498, ASSIGN}] 2023-07-20 15:12:03,475 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=587bffd214e16f85fbb7ee56563ff498, ASSIGN 2023-07-20 15:12:03,475 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=070a19af44cc6d832d86737a466fc9cc, ASSIGN 2023-07-20 15:12:03,475 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=587bffd214e16f85fbb7ee56563ff498, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33243,1689865822788; forceNewPlan=false, retain=false 2023-07-20 15:12:03,475 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=070a19af44cc6d832d86737a466fc9cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45307,1689865822911; forceNewPlan=false, retain=false 2023-07-20 15:12:03,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 15:12:03,626 INFO [jenkins-hbase4:33245] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 15:12:03,629 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=587bffd214e16f85fbb7ee56563ff498, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:03,629 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=070a19af44cc6d832d86737a466fc9cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:03,629 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865923629"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865923629"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865923629"}]},"ts":"1689865923629"} 2023-07-20 15:12:03,629 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865923629"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865923629"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865923629"}]},"ts":"1689865923629"} 2023-07-20 15:12:03,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 587bffd214e16f85fbb7ee56563ff498, server=jenkins-hbase4.apache.org,33243,1689865822788}] 2023-07-20 15:12:03,633 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 070a19af44cc6d832d86737a466fc9cc, server=jenkins-hbase4.apache.org,45307,1689865822911}] 2023-07-20 15:12:03,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 15:12:03,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. 2023-07-20 15:12:03,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 070a19af44cc6d832d86737a466fc9cc, NAME => 'testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 15:12:03,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. service=AccessControlService 2023-07-20 15:12:03,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. 2023-07-20 15:12:03,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:12:03,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 587bffd214e16f85fbb7ee56563ff498, NAME => 'testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 15:12:03,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 070a19af44cc6d832d86737a466fc9cc 2023-07-20 15:12:03,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:12:03,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 070a19af44cc6d832d86737a466fc9cc 2023-07-20 15:12:03,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 070a19af44cc6d832d86737a466fc9cc 2023-07-20 15:12:03,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. service=AccessControlService 2023-07-20 15:12:03,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:12:03,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 587bffd214e16f85fbb7ee56563ff498 2023-07-20 15:12:03,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:12:03,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 587bffd214e16f85fbb7ee56563ff498 2023-07-20 15:12:03,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 587bffd214e16f85fbb7ee56563ff498 2023-07-20 15:12:03,792 INFO [StoreOpener-070a19af44cc6d832d86737a466fc9cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 070a19af44cc6d832d86737a466fc9cc 2023-07-20 15:12:03,792 INFO [StoreOpener-587bffd214e16f85fbb7ee56563ff498-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 587bffd214e16f85fbb7ee56563ff498 2023-07-20 15:12:03,794 DEBUG [StoreOpener-070a19af44cc6d832d86737a466fc9cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc/cf 2023-07-20 15:12:03,794 DEBUG [StoreOpener-070a19af44cc6d832d86737a466fc9cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc/cf 2023-07-20 15:12:03,794 DEBUG [StoreOpener-587bffd214e16f85fbb7ee56563ff498-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498/cf 2023-07-20 15:12:03,794 DEBUG [StoreOpener-587bffd214e16f85fbb7ee56563ff498-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498/cf 2023-07-20 15:12:03,794 INFO [StoreOpener-070a19af44cc6d832d86737a466fc9cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 070a19af44cc6d832d86737a466fc9cc columnFamilyName cf 2023-07-20 15:12:03,794 INFO [StoreOpener-587bffd214e16f85fbb7ee56563ff498-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 587bffd214e16f85fbb7ee56563ff498 columnFamilyName cf 2023-07-20 15:12:03,795 INFO [StoreOpener-070a19af44cc6d832d86737a466fc9cc-1] regionserver.HStore(310): Store=070a19af44cc6d832d86737a466fc9cc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:12:03,795 INFO [StoreOpener-587bffd214e16f85fbb7ee56563ff498-1] regionserver.HStore(310): Store=587bffd214e16f85fbb7ee56563ff498/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:12:03,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc 2023-07-20 15:12:03,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498 2023-07-20 15:12:03,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc 2023-07-20 15:12:03,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498 2023-07-20 15:12:03,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 070a19af44cc6d832d86737a466fc9cc 2023-07-20 15:12:03,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 587bffd214e16f85fbb7ee56563ff498 2023-07-20 15:12:03,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:12:03,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:12:03,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 587bffd214e16f85fbb7ee56563ff498; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61565538, jitterRate=-0.08260199427604675}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:12:03,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 587bffd214e16f85fbb7ee56563ff498: 2023-07-20 15:12:03,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 070a19af44cc6d832d86737a466fc9cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67020732, jitterRate=-0.0013132691383361816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:12:03,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 070a19af44cc6d832d86737a466fc9cc: 2023-07-20 15:12:03,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498., pid=93, masterSystemTime=1689865923784 2023-07-20 15:12:03,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc., pid=94, masterSystemTime=1689865923784 2023-07-20 15:12:03,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. 2023-07-20 15:12:03,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. 2023-07-20 15:12:03,805 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=587bffd214e16f85fbb7ee56563ff498, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:03,805 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865923805"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865923805"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865923805"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865923805"}]},"ts":"1689865923805"} 2023-07-20 15:12:03,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. 2023-07-20 15:12:03,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. 2023-07-20 15:12:03,806 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=070a19af44cc6d832d86737a466fc9cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:03,806 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865923806"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865923806"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865923806"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865923806"}]},"ts":"1689865923806"} 2023-07-20 15:12:03,810 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-20 15:12:03,810 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 587bffd214e16f85fbb7ee56563ff498, server=jenkins-hbase4.apache.org,33243,1689865822788 in 176 msec 2023-07-20 15:12:03,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-20 15:12:03,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=587bffd214e16f85fbb7ee56563ff498, ASSIGN in 338 msec 2023-07-20 15:12:03,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 070a19af44cc6d832d86737a466fc9cc, server=jenkins-hbase4.apache.org,45307,1689865822911 in 175 msec 2023-07-20 15:12:03,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-20 15:12:03,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=070a19af44cc6d832d86737a466fc9cc, ASSIGN in 341 msec 2023-07-20 15:12:03,816 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:12:03,816 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865923816"}]},"ts":"1689865923816"} 2023-07-20 15:12:03,819 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-20 15:12:03,826 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:12:03,827 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-20 15:12:03,829 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40765] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 15:12:03,833 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:03,833 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:03,833 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:03,833 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:03,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:03,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:03,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:03,837 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 429 msec 2023-07-20 15:12:03,839 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:04,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-20 15:12:04,017 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-20 15:12:04,018 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-20 15:12:04,018 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:12:04,022 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-20 15:12:04,022 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:12:04,022 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-20 15:12:04,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:12:04,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865924025 (current time:1689865924025). 2023-07-20 15:12:04,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:12:04,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x0e8d94c2 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:12:04,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bd305a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:12:04,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:04,064 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35172, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:04,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e8d94c2 to 127.0.0.1:60098 2023-07-20 15:12:04,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:12:04,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x10296eea to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:12:04,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7260c3a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:12:04,088 DEBUG [hconnection-0x412d1664-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:04,089 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:04,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10296eea to 127.0.0.1:60098 2023-07-20 15:12:04,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:12:04,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 15:12:04,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:12:04,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:12:04,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:12:04,102 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:12:04,103 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689866524103 2023-07-20 15:12:04,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:12:04,104 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-20 15:12:04,105 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:12:04,105 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:12:04,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 15:12:04,107 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:12:04,109 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-20 15:12:04,113 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 15:12:04,114 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689866524114 2023-07-20 15:12:04,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,143 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-20 15:12:04,143 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:04,145 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-20 15:12:04,145 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-20 15:12:04,205 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:04,210 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,210 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:12:04,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:12:04,213 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:12:04,217 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,217 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,217 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,217 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,218 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,218 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,219 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,219 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:12:04,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 15:12:04,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,219 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,219 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 15:12:04,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 15:12:04,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,219 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 15:12:04,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-20 15:12:04,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,220 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 15:12:04,221 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,221 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 15:12:04,221 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:04,228 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 15:12:04,228 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,228 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 15:12:04,228 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 15:12:04,228 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,228 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:04,229 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 15:12:04,229 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:04,228 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 15:12:04,230 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 15:12:04,230 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 15:12:04,230 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 15:12:04,230 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 15:12:04,230 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 15:12:04,230 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 15:12:04,232 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,233 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,233 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,233 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:04,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:04,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:04,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:04,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,234 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,234 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:04,234 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,234 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,234 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:04,235 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,235 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:04,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 15:12:04,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d340975[Count = 1] remaining members to acquire global barrier 2023-07-20 15:12:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:04,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:04,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:04,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:04,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:04,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 15:12:04,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d340975[Count = 0] remaining members to acquire global barrier 2023-07-20 15:12:04,238 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 15:12:04,239 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,241 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,241 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,241 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,241 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:12:04,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,241 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:12:04,241 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:12:04,241 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 15:12:04,241 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,241 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40765,1689865822857' in zk 2023-07-20 15:12:04,241 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:12:04,241 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:12:04,241 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. 2023-07-20 15:12:04,241 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. started... 2023-07-20 15:12:04,242 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,242 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:12:04,243 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 15:12:04,243 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:04,243 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 15:12:04,245 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:12:04,245 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:12:04,245 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 587bffd214e16f85fbb7ee56563ff498: 2023-07-20 15:12:04,245 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. 2023-07-20 15:12:04,246 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. started... 2023-07-20 15:12:04,246 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,246 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:12:04,247 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:12:04,248 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 070a19af44cc6d832d86737a466fc9cc: 2023-07-20 15:12:04,248 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,248 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:12:04,248 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:12:04,288 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. completed. 2023-07-20 15:12:04,289 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. 2023-07-20 15:12:04,289 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:12:04,289 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:12:04,289 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,289 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 15:12:04,289 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33243,1689865822788' in zk 2023-07-20 15:12:04,291 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 15:12:04,291 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,291 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:04,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:04,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:04,291 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 15:12:04,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:04,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:04,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,298 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. completed. 2023-07-20 15:12:04,298 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. 2023-07-20 15:12:04,298 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:12:04,298 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:12:04,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,298 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,299 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 15:12:04,299 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45307,1689865822911' in zk 2023-07-20 15:12:04,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:04,300 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 15:12:04,300 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,300 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:04,300 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 15:12:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33243,1689865822788': 2023-07-20 15:12:04,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 15:12:04,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:04,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:04,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:04,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:04,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:04,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45307,1689865822911': 2023-07-20 15:12:04,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 15:12:04,309 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-20 15:12:04,309 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:12:04,309 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:12:04,309 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,309 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:12:04,312 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,312 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,312 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,312 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,312 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,313 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:04,313 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,313 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,313 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:04,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,314 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:04,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:04,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,316 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,316 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,316 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:04,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,320 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,320 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,320 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,320 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,320 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,320 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,320 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:04,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,320 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,320 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,320 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,320 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,322 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,322 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,322 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,322 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,323 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,323 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,323 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,323 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,384 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-20 15:12:04,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,384 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689865924104Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689865924320 (+216 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689865924320Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689865924326 (+6 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689865924344 (+18 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689865924384 (+40 ms) 2023-07-20 15:12:04,388 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 15:12:04,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 283 msec 2023-07-20 15:12:04,413 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:04,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:12:04,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:12:04,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45307] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:12:04,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33243] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:12:04,426 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-20 15:12:04,426 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. 2023-07-20 15:12:04,426 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:12:04,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:12:04,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865924443 (current time:1689865924443). 2023-07-20 15:12:04,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:12:04,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x74b703fd to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:12:04,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d80a539, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:12:04,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:04,457 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:04,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74b703fd to 127.0.0.1:60098 2023-07-20 15:12:04,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:12:04,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x2da89e10 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:12:04,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61ccc8b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:12:04,468 DEBUG [hconnection-0x39bd00de-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:04,471 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:04,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2da89e10 to 127.0.0.1:60098 2023-07-20 15:12:04,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:12:04,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-20 15:12:04,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:12:04,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:12:04,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:12:04,480 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:12:04,481 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689866524481 2023-07-20 15:12:04,481 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-20 15:12:04,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-20 15:12:04,483 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:12:04,483 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:12:04,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 15:12:04,486 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-20 15:12:04,487 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-20 15:12:04,488 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 15:12:04,491 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689866524490 2023-07-20 15:12:04,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,503 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-20 15:12:04,503 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:04,505 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-20 15:12:04,505 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-20 15:12:04,505 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,505 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,507 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,507 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,507 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,507 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,507 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,507 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,508 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,508 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:12:04,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 15:12:04,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,509 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 15:12:04,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 15:12:04,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,509 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 15:12:04,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-20 15:12:04,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,509 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 15:12:04,509 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-20 15:12:04,509 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 15:12:04,509 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:04,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,509 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:04,511 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-20 15:12:04,511 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 15:12:04,513 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:04,512 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 15:12:04,513 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 15:12:04,513 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 15:12:04,519 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 15:12:04,519 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-20 15:12:04,519 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-20 15:12:04,519 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 15:12:04,513 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-20 15:12:04,521 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,521 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:04,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:04,523 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,523 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:04,524 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,524 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:04,524 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,524 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,524 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:04,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:04,524 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,524 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:04,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:04,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 15:12:04,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12ae6643[Count = 1] remaining members to acquire global barrier 2023-07-20 15:12:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:04,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:04,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-20 15:12:04,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12ae6643[Count = 0] remaining members to acquire global barrier 2023-07-20 15:12:04,528 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-20 15:12:04,528 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,534 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,534 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,534 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,534 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,534 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:12:04,534 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:12:04,534 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,534 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:12:04,534 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 15:12:04,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:12:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:12:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40765,1689865822857' in zk 2023-07-20 15:12:04,535 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. 2023-07-20 15:12:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-20 15:12:04,535 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. started... 2023-07-20 15:12:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:12:04,535 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:12:04,535 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. 2023-07-20 15:12:04,535 INFO [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 070a19af44cc6d832d86737a466fc9cc 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-20 15:12:04,535 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. started... 2023-07-20 15:12:04,535 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 587bffd214e16f85fbb7ee56563ff498 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-20 15:12:04,536 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 15:12:04,536 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:04,536 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 15:12:04,577 INFO [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc/.tmp/cf/20afaae2b68a4e0e8e234a7c8f1fe94e 2023-07-20 15:12:04,580 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498/.tmp/cf/8598e2e6c2c24f8eb4b00ea5f059f185 2023-07-20 15:12:04,583 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:04,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:12:04,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:12:04,584 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:12:04,588 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc/.tmp/cf/20afaae2b68a4e0e8e234a7c8f1fe94e as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc/cf/20afaae2b68a4e0e8e234a7c8f1fe94e 2023-07-20 15:12:04,605 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498/.tmp/cf/8598e2e6c2c24f8eb4b00ea5f059f185 as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498/cf/8598e2e6c2c24f8eb4b00ea5f059f185 2023-07-20 15:12:04,605 INFO [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc/cf/20afaae2b68a4e0e8e234a7c8f1fe94e, entries=3, sequenceid=6, filesize=5.0 K 2023-07-20 15:12:04,611 INFO [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 070a19af44cc6d832d86737a466fc9cc in 76ms, sequenceid=6, compaction requested=false 2023-07-20 15:12:04,611 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-20 15:12:04,612 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 070a19af44cc6d832d86737a466fc9cc: 2023-07-20 15:12:04,612 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,612 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:12:04,612 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc/cf/20afaae2b68a4e0e8e234a7c8f1fe94e] hfiles 2023-07-20 15:12:04,612 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc/cf/20afaae2b68a4e0e8e234a7c8f1fe94e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,613 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498/cf/8598e2e6c2c24f8eb4b00ea5f059f185, entries=47, sequenceid=6, filesize=8 K 2023-07-20 15:12:04,614 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 587bffd214e16f85fbb7ee56563ff498 in 79ms, sequenceid=6, compaction requested=false 2023-07-20 15:12:04,621 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 587bffd214e16f85fbb7ee56563ff498: 2023-07-20 15:12:04,621 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,623 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:12:04,623 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498/cf/8598e2e6c2c24f8eb4b00ea5f059f185] hfiles 2023-07-20 15:12:04,623 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498/cf/8598e2e6c2c24f8eb4b00ea5f059f185 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,666 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. completed. 2023-07-20 15:12:04,666 DEBUG [rs(jenkins-hbase4.apache.org,45307,1689865822911)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. 2023-07-20 15:12:04,666 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:12:04,666 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:12:04,666 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,679 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 15:12:04,679 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45307,1689865822911' in zk 2023-07-20 15:12:04,686 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,686 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 15:12:04,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:04,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:04,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:04,687 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:04,687 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 15:12:04,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:04,694 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. completed. 2023-07-20 15:12:04,694 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. 2023-07-20 15:12:04,694 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:12:04,695 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:12:04,695 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,695 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-20 15:12:04,695 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33243,1689865822788' in zk 2023-07-20 15:12:04,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,697 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-20 15:12:04,697 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,697 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:04,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,697 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-20 15:12:04,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45307,1689865822911': 2023-07-20 15:12:04,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-20 15:12:04,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:04,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:04,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33243,1689865822788': 2023-07-20 15:12:04,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-20 15:12:04,712 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-20 15:12:04,712 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:12:04,712 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:12:04,712 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,712 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:12:04,715 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,715 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,715 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,715 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,715 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,715 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,715 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:04,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:04,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:04,717 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,717 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,718 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:04,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:04,731 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,732 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,732 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,736 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,736 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,736 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,736 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,736 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,736 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:04,736 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:04,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:04,736 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:04,736 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,737 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,737 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,737 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,737 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:04,737 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:04,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:04,736 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:04,737 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:04,740 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:04,740 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,740 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,785 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:04,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:12:04,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:12:04,786 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-20 15:12:04,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,869 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-20 15:12:04,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,870 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:04,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689865924481Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689865924736 (+255 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689865924736Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689865924768 (+32 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689865924808 (+40 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689865924869 (+61 ms) 2023-07-20 15:12:04,873 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-20 15:12:04,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 391 msec 2023-07-20 15:12:05,086 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:05,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-20 15:12:05,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:12:05,088 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865925088 2023-07-20 15:12:05,088 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34279, tgtDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865925088, rawTgtDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865925088, srcFsUri=hdfs://localhost:34279, srcDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:12:05,115 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34279, inputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:12:05,115 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-988572937_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865925088, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865925088/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:05,115 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34279, inputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84, snapshotDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-20 15:12:05,135 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865925088/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:05,193 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:05,193 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:05,194 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:05,194 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:05,195 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:05,195 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:05,196 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:05,280 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/hadoop-9163600327561540602.jar 2023-07-20 15:12:05,281 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:05,282 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:05,282 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:05,283 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:05,283 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:05,284 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:05,285 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 15:12:05,285 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 15:12:05,286 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 15:12:05,286 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 15:12:05,287 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 15:12:05,287 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 15:12:05,288 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 15:12:05,288 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 15:12:05,288 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 15:12:05,289 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 15:12:05,289 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:12:05,290 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:12:05,290 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:12:05,291 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:12:05,291 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:12:05,291 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:12:05,292 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:12:06,015 WARN [Listener at jenkins-hbase4.apache.org/37809] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 15:12:06,017 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-20 15:12:07,395 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:12:07,395 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:12:07,400 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0005_000001 (auth:SIMPLE) 2023-07-20 15:12:07,655 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0006_000001 (auth:SIMPLE) 2023-07-20 15:12:08,248 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 15:12:14,581 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0006_000001 (auth:SIMPLE) 2023-07-20 15:12:17,441 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 15:12:17,445 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 15:12:17,462 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:17,463 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 15:12:17,464 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 15:12:17,464 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-201645114_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:17,465 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-20 15:12:17,465 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-20 15:12:17,465 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-201645114_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865925088/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865925088/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:17,466 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865925088/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-20 15:12:17,466 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865925088/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-20 15:12:17,472 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,480 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865937480"}]},"ts":"1689865937480"} 2023-07-20 15:12:17,483 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-20 15:12:17,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 15:12:17,487 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-20 15:12:17,490 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=070a19af44cc6d832d86737a466fc9cc, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=587bffd214e16f85fbb7ee56563ff498, UNASSIGN}] 2023-07-20 15:12:17,492 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=070a19af44cc6d832d86737a466fc9cc, UNASSIGN 2023-07-20 15:12:17,492 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=587bffd214e16f85fbb7ee56563ff498, UNASSIGN 2023-07-20 15:12:17,493 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=070a19af44cc6d832d86737a466fc9cc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:17,493 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=587bffd214e16f85fbb7ee56563ff498, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:17,493 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865937493"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865937493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865937493"}]},"ts":"1689865937493"} 2023-07-20 15:12:17,493 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865937493"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865937493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865937493"}]},"ts":"1689865937493"} 2023-07-20 15:12:17,495 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 070a19af44cc6d832d86737a466fc9cc, server=jenkins-hbase4.apache.org,45307,1689865822911}] 2023-07-20 15:12:17,495 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 587bffd214e16f85fbb7ee56563ff498, server=jenkins-hbase4.apache.org,33243,1689865822788}] 2023-07-20 15:12:17,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 15:12:17,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 070a19af44cc6d832d86737a466fc9cc 2023-07-20 15:12:17,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 070a19af44cc6d832d86737a466fc9cc, disabling compactions & flushes 2023-07-20 15:12:17,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. 2023-07-20 15:12:17,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. 2023-07-20 15:12:17,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. after waiting 0 ms 2023-07-20 15:12:17,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. 2023-07-20 15:12:17,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 587bffd214e16f85fbb7ee56563ff498 2023-07-20 15:12:17,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 587bffd214e16f85fbb7ee56563ff498, disabling compactions & flushes 2023-07-20 15:12:17,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. 2023-07-20 15:12:17,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. 2023-07-20 15:12:17,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. after waiting 0 ms 2023-07-20 15:12:17,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. 2023-07-20 15:12:17,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:12:17,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:12:17,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:12:17,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:12:17,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498. 2023-07-20 15:12:17,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc. 2023-07-20 15:12:17,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 587bffd214e16f85fbb7ee56563ff498: 2023-07-20 15:12:17,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 070a19af44cc6d832d86737a466fc9cc: 2023-07-20 15:12:17,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 587bffd214e16f85fbb7ee56563ff498 2023-07-20 15:12:17,674 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=587bffd214e16f85fbb7ee56563ff498, regionState=CLOSED 2023-07-20 15:12:17,674 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865937674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865937674"}]},"ts":"1689865937674"} 2023-07-20 15:12:17,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 070a19af44cc6d832d86737a466fc9cc 2023-07-20 15:12:17,675 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=070a19af44cc6d832d86737a466fc9cc, regionState=CLOSED 2023-07-20 15:12:17,675 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689865937675"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865937675"}]},"ts":"1689865937675"} 2023-07-20 15:12:17,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-20 15:12:17,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 587bffd214e16f85fbb7ee56563ff498, server=jenkins-hbase4.apache.org,33243,1689865822788 in 181 msec 2023-07-20 15:12:17,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-20 15:12:17,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 070a19af44cc6d832d86737a466fc9cc, server=jenkins-hbase4.apache.org,45307,1689865822911 in 183 msec 2023-07-20 15:12:17,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=587bffd214e16f85fbb7ee56563ff498, UNASSIGN in 189 msec 2023-07-20 15:12:17,681 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-20 15:12:17,681 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=070a19af44cc6d832d86737a466fc9cc, UNASSIGN in 189 msec 2023-07-20 15:12:17,682 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865937682"}]},"ts":"1689865937682"} 2023-07-20 15:12:17,683 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-20 15:12:17,685 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-20 15:12:17,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 214 msec 2023-07-20 15:12:17,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-20 15:12:17,790 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-20 15:12:17,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,795 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,796 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,798 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40765] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,801 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,802 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,802 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,802 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 15:12:17,803 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 15:12:17,803 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 15:12:17,803 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-20 15:12:17,803 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498 2023-07-20 15:12:17,803 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc 2023-07-20 15:12:17,804 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,804 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,804 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,804 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:17,804 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:17,804 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:17,804 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,804 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:17,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-20 15:12:17,806 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498/cf, FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498/recovered.edits] 2023-07-20 15:12:17,806 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc/cf, FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc/recovered.edits] 2023-07-20 15:12:17,810 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498/cf/8598e2e6c2c24f8eb4b00ea5f059f185 to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498/cf/8598e2e6c2c24f8eb4b00ea5f059f185 2023-07-20 15:12:17,811 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc/cf/20afaae2b68a4e0e8e234a7c8f1fe94e to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc/cf/20afaae2b68a4e0e8e234a7c8f1fe94e 2023-07-20 15:12:17,814 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498/recovered.edits/9.seqid to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498/recovered.edits/9.seqid 2023-07-20 15:12:17,814 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc/recovered.edits/9.seqid to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc/recovered.edits/9.seqid 2023-07-20 15:12:17,814 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/587bffd214e16f85fbb7ee56563ff498 2023-07-20 15:12:17,814 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testEmptyExportFileSystemState/070a19af44cc6d832d86737a466fc9cc 2023-07-20 15:12:17,815 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-20 15:12:17,817 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,819 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-20 15:12:17,821 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-20 15:12:17,822 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,822 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-20 15:12:17,822 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865937822"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:17,822 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865937822"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:17,824 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 15:12:17,824 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 070a19af44cc6d832d86737a466fc9cc, NAME => 'testtb-testEmptyExportFileSystemState,,1689865923406.070a19af44cc6d832d86737a466fc9cc.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 587bffd214e16f85fbb7ee56563ff498, NAME => 'testtb-testEmptyExportFileSystemState,1,1689865923406.587bffd214e16f85fbb7ee56563ff498.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 15:12:17,824 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-20 15:12:17,824 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689865937824"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:17,826 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-20 15:12:17,827 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-20 15:12:17,828 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 36 msec 2023-07-20 15:12:17,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-20 15:12:17,907 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-20 15:12:17,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-20 15:12:17,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:17,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-20 15:12:17,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-20 15:12:17,952 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 762) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:36463 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-177047452_1 at /127.0.0.1:60018 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4599 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-201645114_17 at /127.0.0.1:52090 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-177047452_1 at /127.0.0.1:52054 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-201645114_17 at /127.0.0.1:33712 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-201645114_17 at /127.0.0.1:60030 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=903 (was 917), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=653 (was 562) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 185), AvailableMemoryMB=1961 (was 2717) 2023-07-20 15:12:17,952 WARN [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-20 15:12:17,980 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=653, ProcessCount=185, AvailableMemoryMB=1961 2023-07-20 15:12:17,981 WARN [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-20 15:12:17,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-20 15:12:17,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:17,987 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-20 15:12:17,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-20 15:12:17,988 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-20 15:12:17,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 15:12:17,998 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741 2023-07-20 15:12:17,998 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426 2023-07-20 15:12:17,999 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741 empty. 2023-07-20 15:12:18,000 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741 2023-07-20 15:12:18,002 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426 empty. 2023-07-20 15:12:18,003 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426 2023-07-20 15:12:18,003 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-20 15:12:18,040 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-20 15:12:18,041 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4ccaf08ce56096820e63fd8fffacc741, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp 2023-07-20 15:12:18,042 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => c2b1b57162f7ff6d0f077d934a26c426, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp 2023-07-20 15:12:18,069 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:12:18,069 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 4ccaf08ce56096820e63fd8fffacc741, disabling compactions & flushes 2023-07-20 15:12:18,069 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. 2023-07-20 15:12:18,069 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. 2023-07-20 15:12:18,069 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:12:18,069 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. after waiting 0 ms 2023-07-20 15:12:18,069 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing c2b1b57162f7ff6d0f077d934a26c426, disabling compactions & flushes 2023-07-20 15:12:18,070 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. 2023-07-20 15:12:18,070 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. 2023-07-20 15:12:18,070 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. 2023-07-20 15:12:18,070 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. 2023-07-20 15:12:18,070 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 4ccaf08ce56096820e63fd8fffacc741: 2023-07-20 15:12:18,070 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. after waiting 0 ms 2023-07-20 15:12:18,070 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. 2023-07-20 15:12:18,070 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. 2023-07-20 15:12:18,070 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for c2b1b57162f7ff6d0f077d934a26c426: 2023-07-20 15:12:18,073 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-20 15:12:18,074 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865938074"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865938074"}]},"ts":"1689865938074"} 2023-07-20 15:12:18,074 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865938074"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865938074"}]},"ts":"1689865938074"} 2023-07-20 15:12:18,076 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-20 15:12:18,077 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-20 15:12:18,077 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865938077"}]},"ts":"1689865938077"} 2023-07-20 15:12:18,079 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-20 15:12:18,083 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-20 15:12:18,084 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-20 15:12:18,084 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-20 15:12:18,084 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-20 15:12:18,084 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-20 15:12:18,084 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ccaf08ce56096820e63fd8fffacc741, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c2b1b57162f7ff6d0f077d934a26c426, ASSIGN}] 2023-07-20 15:12:18,087 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c2b1b57162f7ff6d0f077d934a26c426, ASSIGN 2023-07-20 15:12:18,087 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ccaf08ce56096820e63fd8fffacc741, ASSIGN 2023-07-20 15:12:18,088 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c2b1b57162f7ff6d0f077d934a26c426, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40765,1689865822857; forceNewPlan=false, retain=false 2023-07-20 15:12:18,088 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ccaf08ce56096820e63fd8fffacc741, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33243,1689865822788; forceNewPlan=false, retain=false 2023-07-20 15:12:18,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 15:12:18,238 INFO [jenkins-hbase4:33245] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-20 15:12:18,241 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4ccaf08ce56096820e63fd8fffacc741, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,241 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c2b1b57162f7ff6d0f077d934a26c426, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,241 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865938241"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865938241"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865938241"}]},"ts":"1689865938241"} 2023-07-20 15:12:18,241 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865938241"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865938241"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865938241"}]},"ts":"1689865938241"} 2023-07-20 15:12:18,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 4ccaf08ce56096820e63fd8fffacc741, server=jenkins-hbase4.apache.org,33243,1689865822788}] 2023-07-20 15:12:18,244 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure c2b1b57162f7ff6d0f077d934a26c426, server=jenkins-hbase4.apache.org,40765,1689865822857}] 2023-07-20 15:12:18,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 15:12:18,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. 2023-07-20 15:12:18,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4ccaf08ce56096820e63fd8fffacc741, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741.', STARTKEY => '', ENDKEY => '1'} 2023-07-20 15:12:18,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. service=AccessControlService 2023-07-20 15:12:18,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:12:18,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 4ccaf08ce56096820e63fd8fffacc741 2023-07-20 15:12:18,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:12:18,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4ccaf08ce56096820e63fd8fffacc741 2023-07-20 15:12:18,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4ccaf08ce56096820e63fd8fffacc741 2023-07-20 15:12:18,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. 2023-07-20 15:12:18,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c2b1b57162f7ff6d0f077d934a26c426, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426.', STARTKEY => '1', ENDKEY => ''} 2023-07-20 15:12:18,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. service=AccessControlService 2023-07-20 15:12:18,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-20 15:12:18,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c2b1b57162f7ff6d0f077d934a26c426 2023-07-20 15:12:18,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-20 15:12:18,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c2b1b57162f7ff6d0f077d934a26c426 2023-07-20 15:12:18,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c2b1b57162f7ff6d0f077d934a26c426 2023-07-20 15:12:18,404 INFO [StoreOpener-4ccaf08ce56096820e63fd8fffacc741-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4ccaf08ce56096820e63fd8fffacc741 2023-07-20 15:12:18,404 INFO [StoreOpener-c2b1b57162f7ff6d0f077d934a26c426-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c2b1b57162f7ff6d0f077d934a26c426 2023-07-20 15:12:18,405 DEBUG [StoreOpener-4ccaf08ce56096820e63fd8fffacc741-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741/cf 2023-07-20 15:12:18,405 DEBUG [StoreOpener-4ccaf08ce56096820e63fd8fffacc741-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741/cf 2023-07-20 15:12:18,406 DEBUG [StoreOpener-c2b1b57162f7ff6d0f077d934a26c426-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426/cf 2023-07-20 15:12:18,406 DEBUG [StoreOpener-c2b1b57162f7ff6d0f077d934a26c426-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426/cf 2023-07-20 15:12:18,406 INFO [StoreOpener-4ccaf08ce56096820e63fd8fffacc741-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ccaf08ce56096820e63fd8fffacc741 columnFamilyName cf 2023-07-20 15:12:18,406 INFO [StoreOpener-c2b1b57162f7ff6d0f077d934a26c426-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2b1b57162f7ff6d0f077d934a26c426 columnFamilyName cf 2023-07-20 15:12:18,406 INFO [StoreOpener-4ccaf08ce56096820e63fd8fffacc741-1] regionserver.HStore(310): Store=4ccaf08ce56096820e63fd8fffacc741/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:12:18,407 INFO [StoreOpener-c2b1b57162f7ff6d0f077d934a26c426-1] regionserver.HStore(310): Store=c2b1b57162f7ff6d0f077d934a26c426/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-20 15:12:18,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741 2023-07-20 15:12:18,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426 2023-07-20 15:12:18,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741 2023-07-20 15:12:18,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426 2023-07-20 15:12:18,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c2b1b57162f7ff6d0f077d934a26c426 2023-07-20 15:12:18,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4ccaf08ce56096820e63fd8fffacc741 2023-07-20 15:12:18,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:12:18,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c2b1b57162f7ff6d0f077d934a26c426; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72550842, jitterRate=0.08109179139137268}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:12:18,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c2b1b57162f7ff6d0f077d934a26c426: 2023-07-20 15:12:18,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-20 15:12:18,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426., pid=109, masterSystemTime=1689865938395 2023-07-20 15:12:18,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4ccaf08ce56096820e63fd8fffacc741; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70352292, jitterRate=0.048330843448638916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-20 15:12:18,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4ccaf08ce56096820e63fd8fffacc741: 2023-07-20 15:12:18,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741., pid=108, masterSystemTime=1689865938394 2023-07-20 15:12:18,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. 2023-07-20 15:12:18,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. 2023-07-20 15:12:18,419 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c2b1b57162f7ff6d0f077d934a26c426, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. 2023-07-20 15:12:18,419 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865938419"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865938419"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865938419"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865938419"}]},"ts":"1689865938419"} 2023-07-20 15:12:18,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. 2023-07-20 15:12:18,420 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=4ccaf08ce56096820e63fd8fffacc741, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,420 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865938419"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689865938419"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689865938419"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689865938419"}]},"ts":"1689865938419"} 2023-07-20 15:12:18,422 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-20 15:12:18,423 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure c2b1b57162f7ff6d0f077d934a26c426, server=jenkins-hbase4.apache.org,40765,1689865822857 in 178 msec 2023-07-20 15:12:18,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-20 15:12:18,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 4ccaf08ce56096820e63fd8fffacc741, server=jenkins-hbase4.apache.org,33243,1689865822788 in 178 msec 2023-07-20 15:12:18,424 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c2b1b57162f7ff6d0f077d934a26c426, ASSIGN in 339 msec 2023-07-20 15:12:18,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-20 15:12:18,425 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ccaf08ce56096820e63fd8fffacc741, ASSIGN in 339 msec 2023-07-20 15:12:18,425 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-20 15:12:18,425 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865938425"}]},"ts":"1689865938425"} 2023-07-20 15:12:18,426 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-20 15:12:18,429 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-20 15:12:18,429 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-20 15:12:18,430 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40765] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 15:12:18,432 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:18,432 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:18,432 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:18,432 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:18,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:18,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:18,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:18,434 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 450 msec 2023-07-20 15:12:18,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-20 15:12:18,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-20 15:12:18,593 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-20 15:12:18,593 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-20 15:12:18,593 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:12:18,596 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-20 15:12:18,596 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:12:18,597 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-20 15:12:18,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 15:12:18,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865938599 (current time:1689865938599). 2023-07-20 15:12:18,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:12:18,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x6a72cc28 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:12:18,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cb9e82a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:12:18,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:18,611 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:18,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a72cc28 to 127.0.0.1:60098 2023-07-20 15:12:18,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:12:18,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x6bd6dc58 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:12:18,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17394e86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:12:18,623 DEBUG [hconnection-0x34e21cf3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:18,626 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:18,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bd6dc58 to 127.0.0.1:60098 2023-07-20 15:12:18,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:12:18,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 15:12:18,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:12:18,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 15:12:18,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 15:12:18,635 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 15:12:18,635 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689866538635 2023-07-20 15:12:18,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 15:12:18,635 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,636 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:12:18,637 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:12:18,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 15:12:18,638 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 15:12:18,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-20 15:12:18,640 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 15:12:18,640 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689866538640 2023-07-20 15:12:18,682 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,682 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-20 15:12:18,683 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:18,684 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-20 15:12:18,684 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-20 15:12:18,685 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,685 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,687 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,687 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,687 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,687 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,687 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,687 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,688 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,688 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:12:18,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,689 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 15:12:18,689 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 15:12:18,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,689 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 15:12:18,689 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 15:12:18,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-20 15:12:18,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,689 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 15:12:18,690 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,690 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 15:12:18,690 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:18,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,692 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 15:12:18,692 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 15:12:18,692 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:18,692 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 15:12:18,692 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 15:12:18,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,694 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 15:12:18,694 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 15:12:18,694 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 15:12:18,694 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 15:12:18,694 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:18,696 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 15:12:18,696 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 15:12:18,696 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 15:12:18,700 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,700 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:18,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:18,701 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,701 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:18,701 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,701 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:18,701 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,701 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:18,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:18,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:18,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:18,704 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 15:12:18,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7911dd5c[Count = 1] remaining members to acquire global barrier 2023-07-20 15:12:18,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:18,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:18,704 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,704 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:18,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:18,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:18,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:18,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:18,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 15:12:18,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7911dd5c[Count = 0] remaining members to acquire global barrier 2023-07-20 15:12:18,706 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-20 15:12:18,706 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,709 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,709 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,709 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 15:12:18,709 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,709 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 15:12:18,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,709 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,709 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 15:12:18,709 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45307,1689865822911' in zk 2023-07-20 15:12:18,709 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 15:12:18,710 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,710 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:12:18,710 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:12:18,710 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:12:18,710 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:12:18,710 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:12:18,710 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. 2023-07-20 15:12:18,710 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. started... 2023-07-20 15:12:18,710 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. 2023-07-20 15:12:18,712 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. started... 2023-07-20 15:12:18,714 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 15:12:18,714 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:18,714 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 15:12:18,715 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4ccaf08ce56096820e63fd8fffacc741: 2023-07-20 15:12:18,715 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2b1b57162f7ff6d0f077d934a26c426: 2023-07-20 15:12:18,715 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,715 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,715 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:12:18,715 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:12:18,715 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:12:18,715 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-20 15:12:18,737 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:18,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 15:12:18,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:12:18,739 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:12:18,743 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. completed. 2023-07-20 15:12:18,743 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. 2023-07-20 15:12:18,743 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:12:18,743 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:12:18,743 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,743 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 15:12:18,743 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33243,1689865822788' in zk 2023-07-20 15:12:18,746 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,746 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 15:12:18,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:18,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:18,746 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. completed. 2023-07-20 15:12:18,746 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:18,746 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 15:12:18,746 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. 2023-07-20 15:12:18,748 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:12:18,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:18,748 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:12:18,748 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,748 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 15:12:18,748 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40765,1689865822857' in zk 2023-07-20 15:12:18,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:18,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,749 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,749 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 15:12:18,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,749 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:18,750 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 15:12:18,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:18,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:18,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:18,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33243,1689865822788': 2023-07-20 15:12:18,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-20 15:12:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:18,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:18,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:18,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:18,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:18,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:18,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40765,1689865822857': 2023-07-20 15:12:18,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-20 15:12:18,765 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-20 15:12:18,765 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:12:18,765 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:12:18,765 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,765 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:12:18,775 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,775 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,775 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,775 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,775 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,775 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:18,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:18,775 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,777 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:18,778 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,779 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:18,788 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,791 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:18,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,792 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:18,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,796 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,796 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,796 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,796 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,797 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:18,797 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:18,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:18,797 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:18,797 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,797 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,797 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:18,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:18,797 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,799 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,799 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,799 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:18,799 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,799 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:18,799 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:18,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:18,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:18,799 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,799 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,863 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-20 15:12:18,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,864 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689865938635Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689865938797 (+162 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689865938797Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689865938802 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689865938838 (+36 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689865938863 (+25 ms) 2023-07-20 15:12:18,867 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 15:12:18,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 231 msec 2023-07-20 15:12:18,939 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:18,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 15:12:18,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:12:18,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33243] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:12:18,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40765] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. with WAL disabled. Data may be lost in the event of a crash. 2023-07-20 15:12:18,951 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:18,951 DEBUG [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. 2023-07-20 15:12:18,951 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-20 15:12:18,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 15:12:18,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689865938969 (current time:1689865938969). 2023-07-20 15:12:18,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-20 15:12:18,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x5eb837b0 to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:12:18,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a19ad10, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:12:18,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:18,994 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:18,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5eb837b0 to 127.0.0.1:60098 2023-07-20 15:12:18,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:12:18,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(139): Connect 0x6e78112a to 127.0.0.1:60098 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-20 15:12:19,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7162bee2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-20 15:12:19,069 DEBUG [hconnection-0x46a4fcf3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-20 15:12:19,070 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-20 15:12:19,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e78112a to 127.0.0.1:60098 2023-07-20 15:12:19,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:12:19,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-20 15:12:19,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-20 15:12:19,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 15:12:19,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 15:12:19,079 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 15:12:19,079 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689866539079 2023-07-20 15:12:19,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-20 15:12:19,079 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,080 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-20 15:12:19,081 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-20 15:12:19,081 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-20 15:12:19,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 15:12:19,082 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-07-20 15:12:19,083 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 15:12:19,084 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689866539084 2023-07-20 15:12:19,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,095 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-20 15:12:19,095 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:19,096 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-20 15:12:19,096 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-20 15:12:19,113 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,113 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,143 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:19,143 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,143 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:19,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:19,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:19,143 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:19,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:19,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:19,144 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:19,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:19,144 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,144 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,145 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-20 15:12:19,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 15:12:19,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 15:12:19,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,145 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 15:12:19,145 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 15:12:19,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,145 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,145 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,145 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 15:12:19,145 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:19,146 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 15:12:19,147 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:19,147 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 15:12:19,152 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 15:12:19,152 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 15:12:19,152 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 15:12:19,152 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 15:12:19,152 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45307,1689865822911' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 15:12:19,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-20 15:12:19,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,152 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-20 15:12:19,152 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,152 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-20 15:12:19,152 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-20 15:12:19,154 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-20 15:12:19,154 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-20 15:12:19,154 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-20 15:12:19,166 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,166 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,167 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:19,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:19,181 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:19,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 15:12:19,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-20 15:12:19,182 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-20 15:12:19,182 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,182 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:19,182 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:19,182 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,182 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,182 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:19,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:19,182 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,182 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-20 15:12:19,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:19,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:19,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40765,1689865822857' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 15:12:19,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71b39b04[Count = 1] remaining members to acquire global barrier 2023-07-20 15:12:19,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:19,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:19,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:19,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:19,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:19,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:19,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33243,1689865822788' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-20 15:12:19,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71b39b04[Count = 0] remaining members to acquire global barrier 2023-07-20 15:12:19,186 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-20 15:12:19,186 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,193 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,193 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,193 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,194 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,194 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 15:12:19,194 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 15:12:19,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,194 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:12:19,194 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:12:19,194 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-20 15:12:19,194 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 15:12:19,194 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45307,1689865822911' in zk 2023-07-20 15:12:19,194 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. 2023-07-20 15:12:19,194 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. 2023-07-20 15:12:19,194 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-20 15:12:19,194 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,195 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-20 15:12:19,195 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-20 15:12:19,195 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. started... 2023-07-20 15:12:19,194 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. started... 2023-07-20 15:12:19,195 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4ccaf08ce56096820e63fd8fffacc741 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-20 15:12:19,195 INFO [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c2b1b57162f7ff6d0f077d934a26c426 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-20 15:12:19,197 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 15:12:19,197 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:19,197 DEBUG [member: 'jenkins-hbase4.apache.org,45307,1689865822911' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 15:12:19,214 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741/.tmp/cf/f45c33557dda4469909843beb80f8e2d 2023-07-20 15:12:19,217 INFO [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426/.tmp/cf/ce355b3792b4445482bf1606ea80fb89 2023-07-20 15:12:19,220 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741/.tmp/cf/f45c33557dda4469909843beb80f8e2d as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741/cf/f45c33557dda4469909843beb80f8e2d 2023-07-20 15:12:19,224 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426/.tmp/cf/ce355b3792b4445482bf1606ea80fb89 as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426/cf/ce355b3792b4445482bf1606ea80fb89 2023-07-20 15:12:19,229 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741/cf/f45c33557dda4469909843beb80f8e2d, entries=4, sequenceid=6, filesize=5.1 K 2023-07-20 15:12:19,230 INFO [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426/cf/ce355b3792b4445482bf1606ea80fb89, entries=46, sequenceid=6, filesize=7.9 K 2023-07-20 15:12:19,230 INFO [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 4ccaf08ce56096820e63fd8fffacc741 in 35ms, sequenceid=6, compaction requested=false 2023-07-20 15:12:19,230 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-20 15:12:19,231 INFO [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for c2b1b57162f7ff6d0f077d934a26c426 in 35ms, sequenceid=6, compaction requested=false 2023-07-20 15:12:19,231 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4ccaf08ce56096820e63fd8fffacc741: 2023-07-20 15:12:19,232 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2b1b57162f7ff6d0f077d934a26c426: 2023-07-20 15:12:19,233 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,233 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,233 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:12:19,233 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-20 15:12:19,233 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741/cf/f45c33557dda4469909843beb80f8e2d] hfiles 2023-07-20 15:12:19,233 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426/cf/ce355b3792b4445482bf1606ea80fb89] hfiles 2023-07-20 15:12:19,233 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426/cf/ce355b3792b4445482bf1606ea80fb89 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,233 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741/cf/f45c33557dda4469909843beb80f8e2d for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,251 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. completed. 2023-07-20 15:12:19,251 DEBUG [rs(jenkins-hbase4.apache.org,33243,1689865822788)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. 2023-07-20 15:12:19,251 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:12:19,251 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:12:19,251 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,251 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. completed. 2023-07-20 15:12:19,252 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 15:12:19,252 DEBUG [rs(jenkins-hbase4.apache.org,40765,1689865822857)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. 2023-07-20 15:12:19,252 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33243,1689865822788' in zk 2023-07-20 15:12:19,252 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-20 15:12:19,252 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-20 15:12:19,252 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,252 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-20 15:12:19,252 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40765,1689865822857' in zk 2023-07-20 15:12:19,253 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,254 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 15:12:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:19,254 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,254 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-20 15:12:19,254 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:19,254 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:19,254 DEBUG [member: 'jenkins-hbase4.apache.org,40765,1689865822857' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 15:12:19,255 DEBUG [member: 'jenkins-hbase4.apache.org,33243,1689865822788' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-20 15:12:19,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:19,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:19,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:19,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:19,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:19,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33243,1689865822788': 2023-07-20 15:12:19,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33243,1689865822788' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-20 15:12:19,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:19,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:19,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:19,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:19,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:19,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:19,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:19,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40765,1689865822857': 2023-07-20 15:12:19,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40765,1689865822857' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-20 15:12:19,266 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-20 15:12:19,266 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-20 15:12:19,266 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-20 15:12:19,266 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,266 INFO [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-20 15:12:19,271 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,271 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:19,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,271 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,271 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-20 15:12:19,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-20 15:12:19,271 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:19,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-20 15:12:19,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:19,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:19,272 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:19,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:19,272 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,272 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:19,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:19,273 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:19,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-20 15:12:19,274 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:19,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-20 15:12:19,277 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,277 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:19,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,277 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:19,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,281 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:19,281 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:19,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:19,281 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-20 15:12:19,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:19,281 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:19,282 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,282 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:19,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:19,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:19,282 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,282 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:19,282 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-20 15:12:19,282 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,282 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,282 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:19,282 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-20 15:12:19,282 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,282 DEBUG [(jenkins-hbase4.apache.org,33245,1689865821349)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-20 15:12:19,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,282 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:12:19,282 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:19,284 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,284 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:19,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-20 15:12:19,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:19,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:19,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:19,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-20 15:12:19,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-20 15:12:19,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,363 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-20 15:12:19,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,364 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,365 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689865939080Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689865939282 (+202 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689865939282Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689865939292 (+10 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689865939303 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689865939363 (+60 ms) 2023-07-20 15:12:19,370 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-20 15:12:19,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 291 msec 2023-07-20 15:12:19,382 DEBUG [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-20 15:12:19,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-20 15:12:19,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-20 15:12:19,384 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865939384 2023-07-20 15:12:19,384 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34279, tgtDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865939384, rawTgtDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865939384, srcFsUri=hdfs://localhost:34279, srcDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:12:19,411 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34279, inputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84 2023-07-20 15:12:19,411 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1832414325_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865939384, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865939384/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,412 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34279, inputRoot=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84, snapshotDir=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-20 15:12:19,432 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865939384/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:19,495 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,496 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,496 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,497 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,497 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,497 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,498 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,583 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/hadoop-6503550189329827153.jar 2023-07-20 15:12:19,584 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,584 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,584 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,585 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,585 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,585 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-20 15:12:19,586 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-20 15:12:19,586 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-20 15:12:19,586 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-20 15:12:19,587 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-20 15:12:19,588 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-20 15:12:19,588 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-20 15:12:19,589 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-20 15:12:19,589 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-20 15:12:19,590 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-20 15:12:19,591 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-20 15:12:19,591 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:12:19,592 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:12:19,592 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:12:19,592 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:12:19,593 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-20 15:12:19,593 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:12:19,594 DEBUG [Listener at jenkins-hbase4.apache.org/37809] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-20 15:12:19,952 WARN [Listener at jenkins-hbase4.apache.org/37809] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-20 15:12:19,954 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-20 15:12:19,955 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-20 15:12:22,122 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:12:22,122 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-20 15:12:22,125 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0006_000001 (auth:SIMPLE) 2023-07-20 15:12:22,408 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0007_000001 (auth:SIMPLE) 2023-07-20 15:12:23,292 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 15:12:28,848 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0007_000001 (auth:SIMPLE) 2023-07-20 15:12:31,184 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0007_000001 (auth:SIMPLE) 2023-07-20 15:12:35,743 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689865831849_0007_000001 (auth:SIMPLE) 2023-07-20 15:12:37,189 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-20 15:12:37,189 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-20 15:12:37,201 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,201 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-20 15:12:37,202 INFO [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-20 15:12:37,202 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-201645114_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,203 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-20 15:12:37,203 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-20 15:12:37,203 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-201645114_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865939384/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865939384/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,203 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865939384/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-20 15:12:37,203 DEBUG [Listener at jenkins-hbase4.apache.org/37809] snapshot.TestExportSnapshot(367): hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/export-test/export-1689865939384/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-20 15:12:37,210 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 15:12:37,215 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865957215"}]},"ts":"1689865957215"} 2023-07-20 15:12:37,216 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-20 15:12:37,218 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-20 15:12:37,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ccaf08ce56096820e63fd8fffacc741, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c2b1b57162f7ff6d0f077d934a26c426, UNASSIGN}] 2023-07-20 15:12:37,221 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ccaf08ce56096820e63fd8fffacc741, UNASSIGN 2023-07-20 15:12:37,221 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c2b1b57162f7ff6d0f077d934a26c426, UNASSIGN 2023-07-20 15:12:37,223 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4ccaf08ce56096820e63fd8fffacc741, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:12:37,223 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=c2b1b57162f7ff6d0f077d934a26c426, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:12:37,223 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865957223"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865957223"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865957223"}]},"ts":"1689865957223"} 2023-07-20 15:12:37,223 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865957223"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689865957223"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689865957223"}]},"ts":"1689865957223"} 2023-07-20 15:12:37,224 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 4ccaf08ce56096820e63fd8fffacc741, server=jenkins-hbase4.apache.org,33243,1689865822788}] 2023-07-20 15:12:37,225 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure c2b1b57162f7ff6d0f077d934a26c426, server=jenkins-hbase4.apache.org,40765,1689865822857}] 2023-07-20 15:12:37,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 15:12:37,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4ccaf08ce56096820e63fd8fffacc741 2023-07-20 15:12:37,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4ccaf08ce56096820e63fd8fffacc741, disabling compactions & flushes 2023-07-20 15:12:37,377 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. 2023-07-20 15:12:37,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. 2023-07-20 15:12:37,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. after waiting 0 ms 2023-07-20 15:12:37,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. 2023-07-20 15:12:37,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c2b1b57162f7ff6d0f077d934a26c426 2023-07-20 15:12:37,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c2b1b57162f7ff6d0f077d934a26c426, disabling compactions & flushes 2023-07-20 15:12:37,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. 2023-07-20 15:12:37,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. 2023-07-20 15:12:37,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. after waiting 0 ms 2023-07-20 15:12:37,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. 2023-07-20 15:12:37,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:12:37,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:12:37,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741. 2023-07-20 15:12:37,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4ccaf08ce56096820e63fd8fffacc741: 2023-07-20 15:12:37,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:12:37,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:12:37,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426. 2023-07-20 15:12:37,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c2b1b57162f7ff6d0f077d934a26c426: 2023-07-20 15:12:37,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4ccaf08ce56096820e63fd8fffacc741 2023-07-20 15:12:37,413 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=4ccaf08ce56096820e63fd8fffacc741, regionState=CLOSED 2023-07-20 15:12:37,414 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865957413"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865957413"}]},"ts":"1689865957413"} 2023-07-20 15:12:37,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c2b1b57162f7ff6d0f077d934a26c426 2023-07-20 15:12:37,414 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=c2b1b57162f7ff6d0f077d934a26c426, regionState=CLOSED 2023-07-20 15:12:37,415 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689865957414"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689865957414"}]},"ts":"1689865957414"} 2023-07-20 15:12:37,416 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-20 15:12:37,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 4ccaf08ce56096820e63fd8fffacc741, server=jenkins-hbase4.apache.org,33243,1689865822788 in 191 msec 2023-07-20 15:12:37,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-20 15:12:37,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=4ccaf08ce56096820e63fd8fffacc741, UNASSIGN in 198 msec 2023-07-20 15:12:37,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure c2b1b57162f7ff6d0f077d934a26c426, server=jenkins-hbase4.apache.org,40765,1689865822857 in 191 msec 2023-07-20 15:12:37,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-20 15:12:37,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c2b1b57162f7ff6d0f077d934a26c426, UNASSIGN in 201 msec 2023-07-20 15:12:37,422 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689865957422"}]},"ts":"1689865957422"} 2023-07-20 15:12:37,423 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-20 15:12:37,426 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-20 15:12:37,429 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 216 msec 2023-07-20 15:12:37,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-20 15:12:37,517 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-20 15:12:37,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,522 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,523 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,524 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40765] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,530 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741 2023-07-20 15:12:37,531 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426 2023-07-20 15:12:37,533 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741/cf, FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741/recovered.edits] 2023-07-20 15:12:37,535 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426/cf, FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426/recovered.edits] 2023-07-20 15:12:37,537 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,537 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,537 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,537 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,537 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 15:12:37,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 15:12:37,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 15:12:37,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-20 15:12:37,539 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,539 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,539 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:37,539 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,539 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:37,539 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,539 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:37,539 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-20 15:12:37,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-20 15:12:37,541 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741/cf/f45c33557dda4469909843beb80f8e2d to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741/cf/f45c33557dda4469909843beb80f8e2d 2023-07-20 15:12:37,543 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426/cf/ce355b3792b4445482bf1606ea80fb89 to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426/cf/ce355b3792b4445482bf1606ea80fb89 2023-07-20 15:12:37,548 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741/recovered.edits/9.seqid to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741/recovered.edits/9.seqid 2023-07-20 15:12:37,549 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/4ccaf08ce56096820e63fd8fffacc741 2023-07-20 15:12:37,550 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426/recovered.edits/9.seqid to hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426/recovered.edits/9.seqid 2023-07-20 15:12:37,551 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2b1b57162f7ff6d0f077d934a26c426 2023-07-20 15:12:37,551 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-20 15:12:37,555 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,561 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-20 15:12:37,565 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-20 15:12:37,566 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,566 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-20 15:12:37,567 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865957566"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:37,567 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689865957566"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:37,571 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-20 15:12:37,571 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4ccaf08ce56096820e63fd8fffacc741, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689865937982.4ccaf08ce56096820e63fd8fffacc741.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c2b1b57162f7ff6d0f077d934a26c426, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689865937982.c2b1b57162f7ff6d0f077d934a26c426.', STARTKEY => '1', ENDKEY => ''}] 2023-07-20 15:12:37,571 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-20 15:12:37,572 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689865957571"}]},"ts":"9223372036854775807"} 2023-07-20 15:12:37,575 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-20 15:12:37,579 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 61 msec 2023-07-20 15:12:37,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-20 15:12:37,643 INFO [Listener at jenkins-hbase4.apache.org/37809] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-20 15:12:37,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-20 15:12:37,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-20 15:12:37,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33245] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-20 15:12:37,703 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=768 (was 763) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (274932937) connection to jenkins-hbase4.apache.org/172.31.14.131:37501 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1765462012_1 at /127.0.0.1:60118 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5b8123ab-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1765462012_1 at /127.0.0.1:33168 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-201645114_17 at /127.0.0.1:60140 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-201645114_17 at /127.0.0.1:33202 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5209 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-201645114_17 at /127.0.0.1:43940 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 903), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=655 (was 653) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 185), AvailableMemoryMB=1593 (was 1961) 2023-07-20 15:12:37,704 WARN [Listener at jenkins-hbase4.apache.org/37809] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-20 15:12:37,704 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-20 15:12:37,716 INFO [Listener at jenkins-hbase4.apache.org/37809] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 15:12:37,828 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689865831849_0007_01_000001 is : 143 2023-07-20 15:12:42,977 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-20 15:12:51,835 INFO [Listener at jenkins-hbase4.apache.org/37809] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 15:13:05,984 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 15:13:05,985 INFO [Listener at jenkins-hbase4.apache.org/37809] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 15:13:06,096 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-20 15:13:06,105 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-20 15:13:06,106 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 15:13:06,119 INFO [Listener at jenkins-hbase4.apache.org/37809] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-20 15:13:06,223 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-20 15:13:06,223 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-20 15:13:06,223 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-20 15:13:06,223 INFO [Listener at jenkins-hbase4.apache.org/37809] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-20 15:13:06,223 DEBUG [Listener at jenkins-hbase4.apache.org/37809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d69ecc8 to 127.0.0.1:60098 2023-07-20 15:13:06,223 DEBUG [Listener at jenkins-hbase4.apache.org/37809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:06,223 DEBUG [Listener at jenkins-hbase4.apache.org/37809] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-20 15:13:06,223 DEBUG [Listener at jenkins-hbase4.apache.org/37809] util.JVMClusterUtil(257): Found active master hash=575097186, stopped=false 2023-07-20 15:13:06,224 DEBUG [Listener at jenkins-hbase4.apache.org/37809] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:13:06,224 DEBUG [Listener at jenkins-hbase4.apache.org/37809] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-20 15:13:06,224 INFO [Listener at jenkins-hbase4.apache.org/37809] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33245,1689865821349 2023-07-20 15:13:06,225 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 15:13:06,225 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 15:13:06,225 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 15:13:06,225 INFO [Listener at jenkins-hbase4.apache.org/37809] procedure2.ProcedureExecutor(629): Stopping 2023-07-20 15:13:06,225 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-20 15:13:06,225 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:13:06,226 DEBUG [Listener at jenkins-hbase4.apache.org/37809] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c10070b to 127.0.0.1:60098 2023-07-20 15:13:06,226 DEBUG [Listener at jenkins-hbase4.apache.org/37809] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:06,226 INFO [Listener at jenkins-hbase4.apache.org/37809] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33243,1689865822788' ***** 2023-07-20 15:13:06,226 DEBUG [Listener at jenkins-hbase4.apache.org/37809] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:13:06,226 INFO [Listener at jenkins-hbase4.apache.org/37809] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 15:13:06,226 INFO [Listener at jenkins-hbase4.apache.org/37809] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40765,1689865822857' ***** 2023-07-20 15:13:06,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 15:13:06,227 INFO [RS:0;jenkins-hbase4:33243] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 15:13:06,227 DEBUG [Listener at jenkins-hbase4.apache.org/37809] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:13:06,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 15:13:06,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 15:13:06,227 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 15:13:06,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-20 15:13:06,227 INFO [RS:0;jenkins-hbase4:33243] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 15:13:06,227 INFO [Listener at jenkins-hbase4.apache.org/37809] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 15:13:06,227 INFO [RS:0;jenkins-hbase4:33243] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 15:13:06,227 INFO [Listener at jenkins-hbase4.apache.org/37809] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45307,1689865822911' ***** 2023-07-20 15:13:06,227 INFO [RS:0;jenkins-hbase4:33243] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:13:06,227 INFO [RS:1;jenkins-hbase4:40765] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 15:13:06,227 DEBUG [RS:0;jenkins-hbase4:33243] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29167771 to 127.0.0.1:60098 2023-07-20 15:13:06,228 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 15:13:06,227 DEBUG [Listener at jenkins-hbase4.apache.org/37809] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:13:06,228 DEBUG [RS:0;jenkins-hbase4:33243] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:06,227 INFO [RS:1;jenkins-hbase4:40765] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 15:13:06,228 INFO [Listener at jenkins-hbase4.apache.org/37809] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-20 15:13:06,229 INFO [RS:0;jenkins-hbase4:33243] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33243,1689865822788; all regions closed. 2023-07-20 15:13:06,229 INFO [RS:1;jenkins-hbase4:40765] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 15:13:06,229 INFO [RS:2;jenkins-hbase4:45307] regionserver.HeapMemoryManager(220): Stopping 2023-07-20 15:13:06,229 INFO [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(3305): Received CLOSE for 0b1fc22531f5aafdae2eda161f75d962 2023-07-20 15:13:06,229 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-20 15:13:06,229 INFO [RS:2;jenkins-hbase4:45307] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-20 15:13:06,230 INFO [RS:2;jenkins-hbase4:45307] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-20 15:13:06,230 INFO [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(3305): Received CLOSE for c194f842371b02bf37f277c52f634080 2023-07-20 15:13:06,230 INFO [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:13:06,230 INFO [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:13:06,230 DEBUG [RS:1;jenkins-hbase4:40765] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d935042 to 127.0.0.1:60098 2023-07-20 15:13:06,230 DEBUG [RS:2;jenkins-hbase4:45307] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65dbcfbe to 127.0.0.1:60098 2023-07-20 15:13:06,231 DEBUG [RS:1;jenkins-hbase4:40765] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:06,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c194f842371b02bf37f277c52f634080, disabling compactions & flushes 2023-07-20 15:13:06,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0b1fc22531f5aafdae2eda161f75d962, disabling compactions & flushes 2023-07-20 15:13:06,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080. 2023-07-20 15:13:06,231 DEBUG [RS:2;jenkins-hbase4:45307] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:06,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080. 2023-07-20 15:13:06,233 INFO [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-20 15:13:06,233 INFO [RS:1;jenkins-hbase4:40765] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 15:13:06,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962. 2023-07-20 15:13:06,233 INFO [RS:1;jenkins-hbase4:40765] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 15:13:06,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962. 2023-07-20 15:13:06,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962. after waiting 0 ms 2023-07-20 15:13:06,233 DEBUG [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(1478): Online Regions={c194f842371b02bf37f277c52f634080=hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080.} 2023-07-20 15:13:06,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080. after waiting 0 ms 2023-07-20 15:13:06,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962. 2023-07-20 15:13:06,233 INFO [RS:1;jenkins-hbase4:40765] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 15:13:06,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080. 2023-07-20 15:13:06,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0b1fc22531f5aafdae2eda161f75d962 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-20 15:13:06,234 INFO [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-20 15:13:06,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c194f842371b02bf37f277c52f634080 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-20 15:13:06,234 INFO [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-20 15:13:06,234 DEBUG [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(1478): Online Regions={0b1fc22531f5aafdae2eda161f75d962=hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962., 1588230740=hbase:meta,,1.1588230740} 2023-07-20 15:13:06,234 DEBUG [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(1504): Waiting on c194f842371b02bf37f277c52f634080 2023-07-20 15:13:06,234 DEBUG [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(1504): Waiting on 0b1fc22531f5aafdae2eda161f75d962, 1588230740 2023-07-20 15:13:06,235 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-20 15:13:06,235 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-20 15:13:06,235 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-20 15:13:06,235 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-20 15:13:06,235 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-20 15:13:06,236 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-20 15:13:06,249 DEBUG [RS:0;jenkins-hbase4:33243] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/oldWALs 2023-07-20 15:13:06,249 INFO [RS:0;jenkins-hbase4:33243] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33243%2C1689865822788:(num 1689865825098) 2023-07-20 15:13:06,249 DEBUG [RS:0;jenkins-hbase4:33243] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:06,249 INFO [RS:0;jenkins-hbase4:33243] regionserver.LeaseManager(133): Closed leases 2023-07-20 15:13:06,250 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 15:13:06,251 INFO [RS:0;jenkins-hbase4:33243] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-20 15:13:06,251 INFO [RS:0;jenkins-hbase4:33243] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 15:13:06,251 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 15:13:06,251 INFO [RS:0;jenkins-hbase4:33243] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 15:13:06,252 INFO [RS:0;jenkins-hbase4:33243] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 15:13:06,254 INFO [RS:0;jenkins-hbase4:33243] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33243 2023-07-20 15:13:06,263 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:13:06,263 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:13:06,263 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 15:13:06,263 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 15:13:06,263 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 15:13:06,263 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33243,1689865822788 2023-07-20 15:13:06,263 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 15:13:06,264 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33243,1689865822788] 2023-07-20 15:13:06,264 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33243,1689865822788; numProcessing=1 2023-07-20 15:13:06,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/acl/0b1fc22531f5aafdae2eda161f75d962/.tmp/l/f74272d0050e46e290275015f197554a 2023-07-20 15:13:06,272 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33243,1689865822788 already deleted, retry=false 2023-07-20 15:13:06,272 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33243,1689865822788 expired; onlineServers=2 2023-07-20 15:13:06,272 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/.tmp/info/613d5a85efe6419c95a8109221433e32 2023-07-20 15:13:06,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/namespace/c194f842371b02bf37f277c52f634080/.tmp/info/ef48c8a1cd134a45812ec2d59f8b1fc2 2023-07-20 15:13:06,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f74272d0050e46e290275015f197554a 2023-07-20 15:13:06,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/acl/0b1fc22531f5aafdae2eda161f75d962/.tmp/l/f74272d0050e46e290275015f197554a as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/acl/0b1fc22531f5aafdae2eda161f75d962/l/f74272d0050e46e290275015f197554a 2023-07-20 15:13:06,278 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 613d5a85efe6419c95a8109221433e32 2023-07-20 15:13:06,279 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/namespace/c194f842371b02bf37f277c52f634080/.tmp/info/ef48c8a1cd134a45812ec2d59f8b1fc2 as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/namespace/c194f842371b02bf37f277c52f634080/info/ef48c8a1cd134a45812ec2d59f8b1fc2 2023-07-20 15:13:06,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/namespace/c194f842371b02bf37f277c52f634080/info/ef48c8a1cd134a45812ec2d59f8b1fc2, entries=2, sequenceid=6, filesize=4.8 K 2023-07-20 15:13:06,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c194f842371b02bf37f277c52f634080 in 54ms, sequenceid=6, compaction requested=false 2023-07-20 15:13:06,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f74272d0050e46e290275015f197554a 2023-07-20 15:13:06,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/acl/0b1fc22531f5aafdae2eda161f75d962/l/f74272d0050e46e290275015f197554a, entries=7, sequenceid=18, filesize=5.2 K 2023-07-20 15:13:06,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 0b1fc22531f5aafdae2eda161f75d962 in 58ms, sequenceid=18, compaction requested=false 2023-07-20 15:13:06,294 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 15:13:06,306 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-20 15:13:06,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/namespace/c194f842371b02bf37f277c52f634080/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-20 15:13:06,319 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/acl/0b1fc22531f5aafdae2eda161f75d962/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-20 15:13:06,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:13:06,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962. 2023-07-20 15:13:06,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0b1fc22531f5aafdae2eda161f75d962: 2023-07-20 15:13:06,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689865826627.0b1fc22531f5aafdae2eda161f75d962. 2023-07-20 15:13:06,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:13:06,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080. 2023-07-20 15:13:06,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c194f842371b02bf37f277c52f634080: 2023-07-20 15:13:06,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689865825735.c194f842371b02bf37f277c52f634080. 2023-07-20 15:13:06,350 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/.tmp/rep_barrier/734436859e71413b89820de05d051d25 2023-07-20 15:13:06,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 734436859e71413b89820de05d051d25 2023-07-20 15:13:06,372 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 15:13:06,372 INFO [RS:0;jenkins-hbase4:33243] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33243,1689865822788; zookeeper connection closed. 2023-07-20 15:13:06,372 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:33243-0x10183489c190001, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 15:13:06,372 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@30103972] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@30103972 2023-07-20 15:13:06,376 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/.tmp/table/5bfef314c9db4fe28d34d9ce5dc2a7b5 2023-07-20 15:13:06,382 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5bfef314c9db4fe28d34d9ce5dc2a7b5 2023-07-20 15:13:06,384 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/.tmp/info/613d5a85efe6419c95a8109221433e32 as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/info/613d5a85efe6419c95a8109221433e32 2023-07-20 15:13:06,394 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 613d5a85efe6419c95a8109221433e32 2023-07-20 15:13:06,395 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/info/613d5a85efe6419c95a8109221433e32, entries=48, sequenceid=131, filesize=10.3 K 2023-07-20 15:13:06,400 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/.tmp/rep_barrier/734436859e71413b89820de05d051d25 as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/rep_barrier/734436859e71413b89820de05d051d25 2023-07-20 15:13:06,409 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 734436859e71413b89820de05d051d25 2023-07-20 15:13:06,410 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/rep_barrier/734436859e71413b89820de05d051d25, entries=13, sequenceid=131, filesize=6.4 K 2023-07-20 15:13:06,411 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/.tmp/table/5bfef314c9db4fe28d34d9ce5dc2a7b5 as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/table/5bfef314c9db4fe28d34d9ce5dc2a7b5 2023-07-20 15:13:06,416 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5bfef314c9db4fe28d34d9ce5dc2a7b5 2023-07-20 15:13:06,416 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/table/5bfef314c9db4fe28d34d9ce5dc2a7b5, entries=24, sequenceid=131, filesize=6.9 K 2023-07-20 15:13:06,417 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 181ms, sequenceid=131, compaction requested=false 2023-07-20 15:13:06,435 INFO [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45307,1689865822911; all regions closed. 2023-07-20 15:13:06,435 DEBUG [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-20 15:13:06,450 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-20 15:13:06,451 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-20 15:13:06,451 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-20 15:13:06,453 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-20 15:13:06,454 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-20 15:13:06,454 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-20 15:13:06,459 DEBUG [RS:2;jenkins-hbase4:45307] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/oldWALs 2023-07-20 15:13:06,459 INFO [RS:2;jenkins-hbase4:45307] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45307%2C1689865822911:(num 1689865825089) 2023-07-20 15:13:06,459 DEBUG [RS:2;jenkins-hbase4:45307] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:06,459 INFO [RS:2;jenkins-hbase4:45307] regionserver.LeaseManager(133): Closed leases 2023-07-20 15:13:06,459 INFO [RS:2;jenkins-hbase4:45307] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-20 15:13:06,460 INFO [RS:2;jenkins-hbase4:45307] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-20 15:13:06,460 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 15:13:06,460 INFO [RS:2;jenkins-hbase4:45307] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-20 15:13:06,460 INFO [RS:2;jenkins-hbase4:45307] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-20 15:13:06,461 INFO [RS:2;jenkins-hbase4:45307] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45307 2023-07-20 15:13:06,463 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 15:13:06,463 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:13:06,463 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45307,1689865822911 2023-07-20 15:13:06,464 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45307,1689865822911] 2023-07-20 15:13:06,464 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45307,1689865822911; numProcessing=2 2023-07-20 15:13:06,565 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 15:13:06,565 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:45307-0x10183489c190003, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 15:13:06,565 INFO [RS:2;jenkins-hbase4:45307] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45307,1689865822911; zookeeper connection closed. 2023-07-20 15:13:06,565 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@669eb71a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@669eb71a 2023-07-20 15:13:06,567 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45307,1689865822911 already deleted, retry=false 2023-07-20 15:13:06,567 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45307,1689865822911 expired; onlineServers=1 2023-07-20 15:13:06,635 INFO [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40765,1689865822857; all regions closed. 2023-07-20 15:13:06,640 DEBUG [RS:1;jenkins-hbase4:40765] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/oldWALs 2023-07-20 15:13:06,640 INFO [RS:1;jenkins-hbase4:40765] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40765%2C1689865822857.meta:.meta(num 1689865825323) 2023-07-20 15:13:06,648 DEBUG [RS:1;jenkins-hbase4:40765] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/oldWALs 2023-07-20 15:13:06,648 INFO [RS:1;jenkins-hbase4:40765] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40765%2C1689865822857:(num 1689865825095) 2023-07-20 15:13:06,648 DEBUG [RS:1;jenkins-hbase4:40765] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:06,648 INFO [RS:1;jenkins-hbase4:40765] regionserver.LeaseManager(133): Closed leases 2023-07-20 15:13:06,648 INFO [RS:1;jenkins-hbase4:40765] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-20 15:13:06,648 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 15:13:06,649 INFO [RS:1;jenkins-hbase4:40765] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40765 2023-07-20 15:13:06,651 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-20 15:13:06,651 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40765,1689865822857 2023-07-20 15:13:06,652 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40765,1689865822857] 2023-07-20 15:13:06,652 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40765,1689865822857; numProcessing=3 2023-07-20 15:13:06,653 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40765,1689865822857 already deleted, retry=false 2023-07-20 15:13:06,653 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40765,1689865822857 expired; onlineServers=0 2023-07-20 15:13:06,653 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33245,1689865821349' ***** 2023-07-20 15:13:06,653 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-20 15:13:06,654 DEBUG [M:0;jenkins-hbase4:33245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@637a4359, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-20 15:13:06,654 INFO [M:0;jenkins-hbase4:33245] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33245,1689865821349 2023-07-20 15:13:06,654 INFO [M:0;jenkins-hbase4:33245] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33245,1689865821349; all regions closed. 2023-07-20 15:13:06,654 DEBUG [M:0;jenkins-hbase4:33245] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-20 15:13:06,654 DEBUG [M:0;jenkins-hbase4:33245] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-20 15:13:06,654 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-20 15:13:06,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689865824644] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689865824644,5,FailOnTimeoutGroup] 2023-07-20 15:13:06,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689865824643] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689865824643,5,FailOnTimeoutGroup] 2023-07-20 15:13:06,654 DEBUG [M:0;jenkins-hbase4:33245] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-20 15:13:06,654 INFO [M:0;jenkins-hbase4:33245] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-20 15:13:06,654 INFO [M:0;jenkins-hbase4:33245] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-20 15:13:06,654 INFO [M:0;jenkins-hbase4:33245] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-20 15:13:06,654 DEBUG [M:0;jenkins-hbase4:33245] master.HMaster(1512): Stopping service threads 2023-07-20 15:13:06,655 INFO [M:0;jenkins-hbase4:33245] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-20 15:13:06,655 ERROR [M:0;jenkins-hbase4:33245] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-20 15:13:06,655 INFO [M:0;jenkins-hbase4:33245] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-20 15:13:06,656 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-20 15:13:06,656 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-20 15:13:06,656 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-20 15:13:06,656 DEBUG [M:0;jenkins-hbase4:33245] zookeeper.ZKUtil(398): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-20 15:13:06,656 WARN [M:0;jenkins-hbase4:33245] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-20 15:13:06,656 INFO [M:0;jenkins-hbase4:33245] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-20 15:13:06,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-20 15:13:06,657 INFO [M:0;jenkins-hbase4:33245] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-20 15:13:06,657 DEBUG [M:0;jenkins-hbase4:33245] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-20 15:13:06,657 INFO [M:0;jenkins-hbase4:33245] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 15:13:06,657 DEBUG [M:0;jenkins-hbase4:33245] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 15:13:06,657 DEBUG [M:0;jenkins-hbase4:33245] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-20 15:13:06,657 DEBUG [M:0;jenkins-hbase4:33245] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 15:13:06,657 INFO [M:0;jenkins-hbase4:33245] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.40 KB heapSize=449.66 KB 2023-07-20 15:13:06,687 INFO [M:0;jenkins-hbase4:33245] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.40 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5baac30a8f3f4413858996300b793541 2023-07-20 15:13:06,692 INFO [M:0;jenkins-hbase4:33245] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5baac30a8f3f4413858996300b793541 2023-07-20 15:13:06,693 DEBUG [M:0;jenkins-hbase4:33245] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5baac30a8f3f4413858996300b793541 as hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5baac30a8f3f4413858996300b793541 2023-07-20 15:13:06,699 INFO [M:0;jenkins-hbase4:33245] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5baac30a8f3f4413858996300b793541 2023-07-20 15:13:06,699 INFO [M:0;jenkins-hbase4:33245] regionserver.HStore(1080): Added hdfs://localhost:34279/user/jenkins/test-data/1b0ad4c2-27b1-bdbc-3ad9-a5b17e1a5f84/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5baac30a8f3f4413858996300b793541, entries=119, sequenceid=899, filesize=28.5 K 2023-07-20 15:13:06,700 INFO [M:0;jenkins-hbase4:33245] regionserver.HRegion(2948): Finished flush of dataSize ~373.40 KB/382364, heapSize ~449.64 KB/460432, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 43ms, sequenceid=899, compaction requested=false 2023-07-20 15:13:06,704 INFO [M:0;jenkins-hbase4:33245] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-20 15:13:06,704 DEBUG [M:0;jenkins-hbase4:33245] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-20 15:13:06,723 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-20 15:13:06,723 INFO [M:0;jenkins-hbase4:33245] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-20 15:13:06,724 INFO [M:0;jenkins-hbase4:33245] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33245 2023-07-20 15:13:06,726 DEBUG [M:0;jenkins-hbase4:33245] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33245,1689865821349 already deleted, retry=false 2023-07-20 15:13:06,752 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 15:13:06,752 INFO [RS:1;jenkins-hbase4:40765] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40765,1689865822857; zookeeper connection closed. 2023-07-20 15:13:06,752 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): regionserver:40765-0x10183489c190002, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 15:13:06,753 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@307b48e4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@307b48e4 2023-07-20 15:13:06,753 INFO [Listener at jenkins-hbase4.apache.org/37809] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-20 15:13:06,852 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 15:13:06,852 INFO [M:0;jenkins-hbase4:33245] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33245,1689865821349; zookeeper connection closed. 2023-07-20 15:13:06,853 DEBUG [Listener at localhost/45801-EventThread] zookeeper.ZKWatcher(600): master:33245-0x10183489c190000, quorum=127.0.0.1:60098, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-20 15:13:06,854 WARN [Listener at jenkins-hbase4.apache.org/37809] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 15:13:06,859 INFO [Listener at jenkins-hbase4.apache.org/37809] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 15:13:06,963 WARN [BP-2080548241-172.31.14.131-1689865817332 heartbeating to localhost/127.0.0.1:34279] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 15:13:06,964 WARN [BP-2080548241-172.31.14.131-1689865817332 heartbeating to localhost/127.0.0.1:34279] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2080548241-172.31.14.131-1689865817332 (Datanode Uuid 9399af1c-ea3f-4303-b188-9245ac42f84f) service to localhost/127.0.0.1:34279 2023-07-20 15:13:06,965 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/cluster_360f6e79-b16a-b730-c2d8-9ed046e7a4b0/dfs/data/data5/current/BP-2080548241-172.31.14.131-1689865817332] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 15:13:06,966 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/cluster_360f6e79-b16a-b730-c2d8-9ed046e7a4b0/dfs/data/data6/current/BP-2080548241-172.31.14.131-1689865817332] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 15:13:06,967 WARN [Listener at jenkins-hbase4.apache.org/37809] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 15:13:06,992 INFO [Listener at jenkins-hbase4.apache.org/37809] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 15:13:07,095 WARN [BP-2080548241-172.31.14.131-1689865817332 heartbeating to localhost/127.0.0.1:34279] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 15:13:07,095 WARN [BP-2080548241-172.31.14.131-1689865817332 heartbeating to localhost/127.0.0.1:34279] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2080548241-172.31.14.131-1689865817332 (Datanode Uuid 78054dcf-83cb-412d-bfde-ea0072ff9ca4) service to localhost/127.0.0.1:34279 2023-07-20 15:13:07,096 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/cluster_360f6e79-b16a-b730-c2d8-9ed046e7a4b0/dfs/data/data3/current/BP-2080548241-172.31.14.131-1689865817332] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 15:13:07,096 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/cluster_360f6e79-b16a-b730-c2d8-9ed046e7a4b0/dfs/data/data4/current/BP-2080548241-172.31.14.131-1689865817332] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 15:13:07,097 WARN [Listener at jenkins-hbase4.apache.org/37809] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-20 15:13:07,102 INFO [Listener at jenkins-hbase4.apache.org/37809] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 15:13:07,205 WARN [BP-2080548241-172.31.14.131-1689865817332 heartbeating to localhost/127.0.0.1:34279] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-20 15:13:07,205 WARN [BP-2080548241-172.31.14.131-1689865817332 heartbeating to localhost/127.0.0.1:34279] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2080548241-172.31.14.131-1689865817332 (Datanode Uuid a1389188-ac9e-4b25-a960-b10a351d4208) service to localhost/127.0.0.1:34279 2023-07-20 15:13:07,206 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/cluster_360f6e79-b16a-b730-c2d8-9ed046e7a4b0/dfs/data/data1/current/BP-2080548241-172.31.14.131-1689865817332] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 15:13:07,206 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8dd34e8f-53cf-5e2c-a334-f653ba3fb48d/cluster_360f6e79-b16a-b730-c2d8-9ed046e7a4b0/dfs/data/data2/current/BP-2080548241-172.31.14.131-1689865817332] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-20 15:13:07,230 INFO [Listener at jenkins-hbase4.apache.org/37809] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-20 15:13:07,360 INFO [Listener at jenkins-hbase4.apache.org/37809] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-20 15:13:07,447 INFO [Listener at jenkins-hbase4.apache.org/37809] hbase.HBaseTestingUtility(1293): Minicluster is down