2023-07-22 00:06:12,517 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-22 00:06:12,781 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8 2023-07-22 00:06:12,781 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-22 00:06:12,822 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-22 00:06:13,071 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-22 00:06:13,072 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/cluster_0032ba5a-a217-3173-3cbc-083e8f7fc05b, deleteOnExit=true 2023-07-22 00:06:13,072 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-22 00:06:13,073 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/test.cache.data in system properties and HBase conf 2023-07-22 00:06:13,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/hadoop.tmp.dir in system properties and HBase conf 2023-07-22 00:06:13,074 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/hadoop.log.dir in system properties and HBase conf 2023-07-22 00:06:13,075 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-22 00:06:13,075 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-22 00:06:13,076 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-22 00:06:13,451 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-22 00:06:13,457 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-22 00:06:13,458 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-22 00:06:13,458 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-22 00:06:13,459 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 00:06:13,459 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-22 00:06:13,460 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-22 00:06:13,460 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 00:06:13,460 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 00:06:13,461 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-22 00:06:13,461 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/nfs.dump.dir in system properties and HBase conf 2023-07-22 00:06:13,462 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/java.io.tmpdir in system properties and HBase conf 2023-07-22 00:06:13,462 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 00:06:13,463 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-22 00:06:13,463 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-22 00:06:14,053 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-22 00:06:14,057 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-22 00:06:14,343 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-22 00:06:14,520 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-22 00:06:14,540 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 00:06:14,586 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 00:06:14,622 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/java.io.tmpdir/Jetty_localhost_33797_hdfs____zh3b33/webapp 2023-07-22 00:06:14,771 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33797 2023-07-22 00:06:14,820 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-22 00:06:14,820 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-22 00:06:15,460 WARN [Listener at localhost/34573] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 00:06:15,549 WARN [Listener at localhost/34573] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 00:06:15,576 WARN [Listener at localhost/34573] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 00:06:15,584 INFO [Listener at localhost/34573] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 00:06:15,590 INFO [Listener at localhost/34573] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/java.io.tmpdir/Jetty_localhost_37079_datanode____.shbmjv/webapp 2023-07-22 00:06:15,708 INFO [Listener at localhost/34573] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37079 2023-07-22 00:06:16,261 WARN [Listener at localhost/42883] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 00:06:16,306 WARN [Listener at localhost/42883] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 00:06:16,310 WARN [Listener at localhost/42883] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 00:06:16,313 INFO [Listener at localhost/42883] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 00:06:16,322 INFO [Listener at localhost/42883] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/java.io.tmpdir/Jetty_localhost_41071_datanode____ccipqs/webapp 2023-07-22 00:06:16,455 INFO [Listener at localhost/42883] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41071 2023-07-22 00:06:16,474 WARN [Listener at localhost/40721] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 00:06:16,543 WARN [Listener at localhost/40721] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-22 00:06:16,547 WARN [Listener at localhost/40721] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 00:06:16,549 INFO [Listener at localhost/40721] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 00:06:16,557 INFO [Listener at localhost/40721] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/java.io.tmpdir/Jetty_localhost_43449_datanode____af8czl/webapp 2023-07-22 00:06:16,698 INFO [Listener at localhost/40721] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43449 2023-07-22 00:06:16,715 WARN [Listener at localhost/38513] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-22 00:06:16,985 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x12ec05a6f45db04a: Processing first storage report for DS-d96c6b5e-bb13-4dff-b20c-1c61bf3daca3 from datanode 48ce9b85-c313-4ad1-a1bc-570ffb0fb162 2023-07-22 00:06:16,987 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x12ec05a6f45db04a: from storage DS-d96c6b5e-bb13-4dff-b20c-1c61bf3daca3 node DatanodeRegistration(127.0.0.1:44375, datanodeUuid=48ce9b85-c313-4ad1-a1bc-570ffb0fb162, infoPort=40145, infoSecurePort=0, ipcPort=40721, storageInfo=lv=-57;cid=testClusterID;nsid=112237664;c=1689984374130), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-22 00:06:16,987 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x66ab0dc5844ea2e2: Processing first storage report for DS-090716f8-f0ae-4891-aa75-3281275f526c from datanode a3fd7a08-15de-4370-a234-794df38661d0 2023-07-22 00:06:16,987 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x66ab0dc5844ea2e2: from storage DS-090716f8-f0ae-4891-aa75-3281275f526c node DatanodeRegistration(127.0.0.1:44275, datanodeUuid=a3fd7a08-15de-4370-a234-794df38661d0, infoPort=39107, infoSecurePort=0, ipcPort=38513, storageInfo=lv=-57;cid=testClusterID;nsid=112237664;c=1689984374130), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 00:06:16,987 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdc4520861a8eafc3: Processing first storage report for DS-3d236351-a1c1-432c-a701-2c8bbfdf088c from datanode a2dbf587-4819-4140-b54b-6eb143c0b9e6 2023-07-22 00:06:16,988 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdc4520861a8eafc3: from storage DS-3d236351-a1c1-432c-a701-2c8bbfdf088c node DatanodeRegistration(127.0.0.1:34293, datanodeUuid=a2dbf587-4819-4140-b54b-6eb143c0b9e6, infoPort=38405, infoSecurePort=0, ipcPort=42883, storageInfo=lv=-57;cid=testClusterID;nsid=112237664;c=1689984374130), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-22 00:06:16,988 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x12ec05a6f45db04a: Processing first storage report for DS-8e560d15-cdb9-4659-88c4-e8d7eb2ccddc from datanode 48ce9b85-c313-4ad1-a1bc-570ffb0fb162 2023-07-22 00:06:16,988 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x12ec05a6f45db04a: from storage DS-8e560d15-cdb9-4659-88c4-e8d7eb2ccddc node DatanodeRegistration(127.0.0.1:44375, datanodeUuid=48ce9b85-c313-4ad1-a1bc-570ffb0fb162, infoPort=40145, infoSecurePort=0, ipcPort=40721, storageInfo=lv=-57;cid=testClusterID;nsid=112237664;c=1689984374130), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 00:06:16,988 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x66ab0dc5844ea2e2: Processing first storage report for DS-2c6fce23-eb06-4b0c-bdb7-88e418048b39 from datanode a3fd7a08-15de-4370-a234-794df38661d0 2023-07-22 00:06:16,988 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x66ab0dc5844ea2e2: from storage DS-2c6fce23-eb06-4b0c-bdb7-88e418048b39 node DatanodeRegistration(127.0.0.1:44275, datanodeUuid=a3fd7a08-15de-4370-a234-794df38661d0, infoPort=39107, infoSecurePort=0, ipcPort=38513, storageInfo=lv=-57;cid=testClusterID;nsid=112237664;c=1689984374130), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 00:06:16,989 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xdc4520861a8eafc3: Processing first storage report for DS-b6c3bcc0-476c-457a-b449-7738b69fc7e7 from datanode a2dbf587-4819-4140-b54b-6eb143c0b9e6 2023-07-22 00:06:16,989 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xdc4520861a8eafc3: from storage DS-b6c3bcc0-476c-457a-b449-7738b69fc7e7 node DatanodeRegistration(127.0.0.1:34293, datanodeUuid=a2dbf587-4819-4140-b54b-6eb143c0b9e6, infoPort=38405, infoSecurePort=0, ipcPort=42883, storageInfo=lv=-57;cid=testClusterID;nsid=112237664;c=1689984374130), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-22 00:06:17,212 DEBUG [Listener at localhost/38513] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8 2023-07-22 00:06:17,316 INFO [Listener at localhost/38513] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/cluster_0032ba5a-a217-3173-3cbc-083e8f7fc05b/zookeeper_0, clientPort=58666, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/cluster_0032ba5a-a217-3173-3cbc-083e8f7fc05b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/cluster_0032ba5a-a217-3173-3cbc-083e8f7fc05b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-22 00:06:17,333 INFO [Listener at localhost/38513] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58666 2023-07-22 00:06:17,342 INFO [Listener at localhost/38513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:17,345 INFO [Listener at localhost/38513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:18,046 INFO [Listener at localhost/38513] util.FSUtils(471): Created version file at hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d with version=8 2023-07-22 00:06:18,046 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/hbase-staging 2023-07-22 00:06:18,405 INFO [Listener at localhost/38513] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-22 00:06:18,995 INFO [Listener at localhost/38513] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 00:06:19,033 INFO [Listener at localhost/38513] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,034 INFO [Listener at localhost/38513] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,035 INFO [Listener at localhost/38513] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 00:06:19,035 INFO [Listener at localhost/38513] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,035 INFO [Listener at localhost/38513] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 00:06:19,214 INFO [Listener at localhost/38513] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 00:06:19,295 DEBUG [Listener at localhost/38513] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-22 00:06:19,400 INFO [Listener at localhost/38513] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42695 2023-07-22 00:06:19,415 INFO [Listener at localhost/38513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,418 INFO [Listener at localhost/38513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,449 INFO [Listener at localhost/38513] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42695 connecting to ZooKeeper ensemble=127.0.0.1:58666 2023-07-22 00:06:19,514 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:426950x0, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 00:06:19,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42695-0x1018a59a4ce0000 connected 2023-07-22 00:06:19,564 DEBUG [Listener at localhost/38513] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 00:06:19,565 DEBUG [Listener at localhost/38513] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 00:06:19,587 DEBUG [Listener at localhost/38513] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 00:06:19,599 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42695 2023-07-22 00:06:19,599 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42695 2023-07-22 00:06:19,600 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42695 2023-07-22 00:06:19,602 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42695 2023-07-22 00:06:19,603 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42695 2023-07-22 00:06:19,609 INFO [Listener at localhost/38513] master.HMaster(444): hbase.rootdir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d, hbase.cluster.distributed=false 2023-07-22 00:06:19,685 INFO [Listener at localhost/38513] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 00:06:19,685 INFO [Listener at localhost/38513] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,685 INFO [Listener at localhost/38513] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,686 INFO [Listener at localhost/38513] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 00:06:19,686 INFO [Listener at localhost/38513] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,686 INFO [Listener at localhost/38513] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 00:06:19,690 INFO [Listener at localhost/38513] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 00:06:19,693 INFO [Listener at localhost/38513] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40519 2023-07-22 00:06:19,696 INFO [Listener at localhost/38513] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 00:06:19,706 DEBUG [Listener at localhost/38513] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-22 00:06:19,708 INFO [Listener at localhost/38513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,711 INFO [Listener at localhost/38513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,713 INFO [Listener at localhost/38513] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40519 connecting to ZooKeeper ensemble=127.0.0.1:58666 2023-07-22 00:06:19,722 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:405190x0, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 00:06:19,723 DEBUG [Listener at localhost/38513] zookeeper.ZKUtil(164): regionserver:405190x0, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 00:06:19,723 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40519-0x1018a59a4ce0001 connected 2023-07-22 00:06:19,725 DEBUG [Listener at localhost/38513] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 00:06:19,726 DEBUG [Listener at localhost/38513] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 00:06:19,727 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40519 2023-07-22 00:06:19,731 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40519 2023-07-22 00:06:19,731 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40519 2023-07-22 00:06:19,732 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40519 2023-07-22 00:06:19,732 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40519 2023-07-22 00:06:19,746 INFO [Listener at localhost/38513] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 00:06:19,746 INFO [Listener at localhost/38513] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,746 INFO [Listener at localhost/38513] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,747 INFO [Listener at localhost/38513] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 00:06:19,747 INFO [Listener at localhost/38513] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,747 INFO [Listener at localhost/38513] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 00:06:19,747 INFO [Listener at localhost/38513] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 00:06:19,751 INFO [Listener at localhost/38513] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35499 2023-07-22 00:06:19,752 INFO [Listener at localhost/38513] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 00:06:19,753 DEBUG [Listener at localhost/38513] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-22 00:06:19,754 INFO [Listener at localhost/38513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,757 INFO [Listener at localhost/38513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,761 INFO [Listener at localhost/38513] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35499 connecting to ZooKeeper ensemble=127.0.0.1:58666 2023-07-22 00:06:19,769 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:354990x0, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 00:06:19,770 DEBUG [Listener at localhost/38513] zookeeper.ZKUtil(164): regionserver:354990x0, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 00:06:19,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35499-0x1018a59a4ce0002 connected 2023-07-22 00:06:19,776 DEBUG [Listener at localhost/38513] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 00:06:19,777 DEBUG [Listener at localhost/38513] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 00:06:19,783 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35499 2023-07-22 00:06:19,783 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35499 2023-07-22 00:06:19,788 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35499 2023-07-22 00:06:19,788 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35499 2023-07-22 00:06:19,789 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35499 2023-07-22 00:06:19,802 INFO [Listener at localhost/38513] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-22 00:06:19,802 INFO [Listener at localhost/38513] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,802 INFO [Listener at localhost/38513] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,802 INFO [Listener at localhost/38513] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-22 00:06:19,803 INFO [Listener at localhost/38513] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-22 00:06:19,803 INFO [Listener at localhost/38513] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-22 00:06:19,803 INFO [Listener at localhost/38513] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-22 00:06:19,808 INFO [Listener at localhost/38513] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43309 2023-07-22 00:06:19,809 INFO [Listener at localhost/38513] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-22 00:06:19,810 DEBUG [Listener at localhost/38513] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-22 00:06:19,812 INFO [Listener at localhost/38513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,814 INFO [Listener at localhost/38513] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:19,815 INFO [Listener at localhost/38513] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43309 connecting to ZooKeeper ensemble=127.0.0.1:58666 2023-07-22 00:06:19,824 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:433090x0, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-22 00:06:19,826 DEBUG [Listener at localhost/38513] zookeeper.ZKUtil(164): regionserver:433090x0, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 00:06:19,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43309-0x1018a59a4ce0003 connected 2023-07-22 00:06:19,827 DEBUG [Listener at localhost/38513] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 00:06:19,828 DEBUG [Listener at localhost/38513] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-22 00:06:19,829 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43309 2023-07-22 00:06:19,830 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43309 2023-07-22 00:06:19,830 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43309 2023-07-22 00:06:19,835 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43309 2023-07-22 00:06:19,835 DEBUG [Listener at localhost/38513] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43309 2023-07-22 00:06:19,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42695,1689984378224 2023-07-22 00:06:19,847 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-22 00:06:19,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42695,1689984378224 2023-07-22 00:06:19,874 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 00:06:19,874 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 00:06:19,874 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 00:06:19,874 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-22 00:06:19,875 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:19,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-22 00:06:19,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42695,1689984378224 from backup master directory 2023-07-22 00:06:19,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-22 00:06:19,882 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42695,1689984378224 2023-07-22 00:06:19,882 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-22 00:06:19,883 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 00:06:19,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42695,1689984378224 2023-07-22 00:06:19,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-22 00:06:19,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-22 00:06:20,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/hbase.id with ID: b98f0333-26f0-4bbf-a012-0b81de7ed80d 2023-07-22 00:06:20,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-22 00:06:20,112 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:20,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6fca17b4 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:20,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74a3b040, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:20,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 00:06:20,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-22 00:06:20,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-22 00:06:20,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-22 00:06:20,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-22 00:06:20,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-22 00:06:20,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 00:06:20,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/MasterData/data/master/store-tmp 2023-07-22 00:06:20,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:20,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-22 00:06:20,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 00:06:20,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 00:06:20,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-22 00:06:20,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 00:06:20,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 00:06:20,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 00:06:20,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/MasterData/WALs/jenkins-hbase4.apache.org,42695,1689984378224 2023-07-22 00:06:20,494 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42695%2C1689984378224, suffix=, logDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/MasterData/WALs/jenkins-hbase4.apache.org,42695,1689984378224, archiveDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/MasterData/oldWALs, maxLogs=10 2023-07-22 00:06:20,580 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44375,DS-d96c6b5e-bb13-4dff-b20c-1c61bf3daca3,DISK] 2023-07-22 00:06:20,580 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44275,DS-090716f8-f0ae-4891-aa75-3281275f526c,DISK] 2023-07-22 00:06:20,580 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34293,DS-3d236351-a1c1-432c-a701-2c8bbfdf088c,DISK] 2023-07-22 00:06:20,591 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-22 00:06:20,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/MasterData/WALs/jenkins-hbase4.apache.org,42695,1689984378224/jenkins-hbase4.apache.org%2C42695%2C1689984378224.1689984380509 2023-07-22 00:06:20,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34293,DS-3d236351-a1c1-432c-a701-2c8bbfdf088c,DISK], DatanodeInfoWithStorage[127.0.0.1:44375,DS-d96c6b5e-bb13-4dff-b20c-1c61bf3daca3,DISK], DatanodeInfoWithStorage[127.0.0.1:44275,DS-090716f8-f0ae-4891-aa75-3281275f526c,DISK]] 2023-07-22 00:06:20,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-22 00:06:20,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:20,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 00:06:20,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 00:06:20,775 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-22 00:06:20,782 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-22 00:06:20,822 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-22 00:06:20,836 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:20,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-22 00:06:20,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-22 00:06:20,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-22 00:06:20,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:06:20,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66101754, jitterRate=-0.015007108449935913}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:06:20,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 00:06:20,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-22 00:06:20,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-22 00:06:20,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-22 00:06:20,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-22 00:06:20,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-22 00:06:20,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 47 msec 2023-07-22 00:06:20,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-22 00:06:20,992 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-22 00:06:20,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-22 00:06:21,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-22 00:06:21,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-22 00:06:21,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-22 00:06:21,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-22 00:06:21,057 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-22 00:06:21,061 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:21,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-22 00:06:21,064 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-22 00:06:21,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-22 00:06:21,087 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 00:06:21,087 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 00:06:21,088 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 00:06:21,088 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-22 00:06:21,088 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:21,091 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42695,1689984378224, sessionid=0x1018a59a4ce0000, setting cluster-up flag (Was=false) 2023-07-22 00:06:21,113 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:21,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-22 00:06:21,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42695,1689984378224 2023-07-22 00:06:21,128 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:21,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-22 00:06:21,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42695,1689984378224 2023-07-22 00:06:21,140 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp 2023-07-22 00:06:21,245 INFO [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(951): ClusterId : b98f0333-26f0-4bbf-a012-0b81de7ed80d 2023-07-22 00:06:21,246 INFO [RS:1;jenkins-hbase4:35499] regionserver.HRegionServer(951): ClusterId : b98f0333-26f0-4bbf-a012-0b81de7ed80d 2023-07-22 00:06:21,262 INFO [RS:2;jenkins-hbase4:43309] regionserver.HRegionServer(951): ClusterId : b98f0333-26f0-4bbf-a012-0b81de7ed80d 2023-07-22 00:06:21,265 DEBUG [RS:1;jenkins-hbase4:35499] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 00:06:21,265 DEBUG [RS:0;jenkins-hbase4:40519] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 00:06:21,267 DEBUG [RS:2;jenkins-hbase4:43309] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-22 00:06:21,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-22 00:06:21,273 DEBUG [RS:2;jenkins-hbase4:43309] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 00:06:21,274 DEBUG [RS:2;jenkins-hbase4:43309] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 00:06:21,275 DEBUG [RS:0;jenkins-hbase4:40519] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 00:06:21,275 DEBUG [RS:0;jenkins-hbase4:40519] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 00:06:21,276 DEBUG [RS:1;jenkins-hbase4:35499] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-22 00:06:21,276 DEBUG [RS:1;jenkins-hbase4:35499] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-22 00:06:21,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:21,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-22 00:06:21,281 DEBUG [RS:2;jenkins-hbase4:43309] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 00:06:21,282 DEBUG [RS:0;jenkins-hbase4:40519] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 00:06:21,282 DEBUG [RS:1;jenkins-hbase4:35499] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-22 00:06:21,282 DEBUG [RS:2;jenkins-hbase4:43309] zookeeper.ReadOnlyZKClient(139): Connect 0x1953db9a to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:21,285 DEBUG [RS:0;jenkins-hbase4:40519] zookeeper.ReadOnlyZKClient(139): Connect 0x3ebbd897 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:21,289 DEBUG [RS:1;jenkins-hbase4:35499] zookeeper.ReadOnlyZKClient(139): Connect 0x0bf66e8f to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:21,327 DEBUG [RS:0;jenkins-hbase4:40519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@557a9545, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:21,328 DEBUG [RS:2;jenkins-hbase4:43309] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d30c057, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:21,328 DEBUG [RS:0;jenkins-hbase4:40519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46ffc132, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 00:06:21,328 DEBUG [RS:2;jenkins-hbase4:43309] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8eb8df0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 00:06:21,363 DEBUG [RS:2;jenkins-hbase4:43309] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:43309 2023-07-22 00:06:21,371 INFO [RS:2;jenkins-hbase4:43309] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 00:06:21,371 INFO [RS:2;jenkins-hbase4:43309] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 00:06:21,371 DEBUG [RS:2;jenkins-hbase4:43309] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 00:06:21,377 INFO [RS:2;jenkins-hbase4:43309] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:21,378 DEBUG [RS:2;jenkins-hbase4:43309] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 00:06:21,380 DEBUG [RS:0;jenkins-hbase4:40519] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40519 2023-07-22 00:06:21,381 INFO [RS:0;jenkins-hbase4:40519] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 00:06:21,382 INFO [RS:0;jenkins-hbase4:40519] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 00:06:21,382 INFO [RS:2;jenkins-hbase4:43309] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42695,1689984378224 with isa=jenkins-hbase4.apache.org/172.31.14.131:43309, startcode=1689984379801 2023-07-22 00:06:21,382 DEBUG [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 00:06:21,382 DEBUG [RS:1;jenkins-hbase4:35499] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57c57b53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:21,382 INFO [RS:0;jenkins-hbase4:40519] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:21,383 DEBUG [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 00:06:21,383 DEBUG [RS:1;jenkins-hbase4:35499] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15918dc5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 00:06:21,384 INFO [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42695,1689984378224 with isa=jenkins-hbase4.apache.org/172.31.14.131:40519, startcode=1689984379684 2023-07-22 00:06:21,393 DEBUG [RS:1;jenkins-hbase4:35499] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35499 2023-07-22 00:06:21,393 INFO [RS:1;jenkins-hbase4:35499] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-22 00:06:21,393 INFO [RS:1;jenkins-hbase4:35499] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-22 00:06:21,394 DEBUG [RS:1;jenkins-hbase4:35499] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-22 00:06:21,394 INFO [RS:1;jenkins-hbase4:35499] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:21,394 DEBUG [RS:1;jenkins-hbase4:35499] regionserver.HRegionServer(1022): About to register with Master. 2023-07-22 00:06:21,395 INFO [RS:1;jenkins-hbase4:35499] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42695,1689984378224 with isa=jenkins-hbase4.apache.org/172.31.14.131:35499, startcode=1689984379745 2023-07-22 00:06:21,405 DEBUG [RS:1;jenkins-hbase4:35499] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 00:06:21,405 DEBUG [RS:2;jenkins-hbase4:43309] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 00:06:21,405 DEBUG [RS:0;jenkins-hbase4:40519] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-22 00:06:21,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-22 00:06:21,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 00:06:21,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 00:06:21,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 00:06:21,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-22 00:06:21,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-22 00:06:21,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 00:06:21,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689984411442 2023-07-22 00:06:21,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-22 00:06:21,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-22 00:06:21,470 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-22 00:06:21,471 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-22 00:06:21,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-22 00:06:21,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-22 00:06:21,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-22 00:06:21,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-22 00:06:21,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,478 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 00:06:21,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-22 00:06:21,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-22 00:06:21,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-22 00:06:21,490 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44735, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 00:06:21,491 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45739, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 00:06:21,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-22 00:06:21,490 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39077, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-22 00:06:21,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-22 00:06:21,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689984381494,5,FailOnTimeoutGroup] 2023-07-22 00:06:21,506 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689984381503,5,FailOnTimeoutGroup] 2023-07-22 00:06:21,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-22 00:06:21,508 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42695] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-22 00:06:21,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,532 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42695] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:21,540 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42695] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:21,547 DEBUG [RS:2;jenkins-hbase4:43309] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:06:21,547 DEBUG [RS:2;jenkins-hbase4:43309] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34573 2023-07-22 00:06:21,547 DEBUG [RS:2;jenkins-hbase4:43309] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 00:06:21,551 DEBUG [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:06:21,551 DEBUG [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34573 2023-07-22 00:06:21,551 DEBUG [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 00:06:21,553 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 00:06:21,559 DEBUG [RS:1;jenkins-hbase4:35499] regionserver.HRegionServer(2830): Master is not running yet 2023-07-22 00:06:21,560 WARN [RS:1;jenkins-hbase4:35499] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-22 00:06:21,562 DEBUG [RS:2;jenkins-hbase4:43309] zookeeper.ZKUtil(162): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:21,562 WARN [RS:2;jenkins-hbase4:43309] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 00:06:21,563 DEBUG [RS:0;jenkins-hbase4:40519] zookeeper.ZKUtil(162): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:21,564 WARN [RS:0;jenkins-hbase4:40519] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 00:06:21,563 INFO [RS:2;jenkins-hbase4:43309] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 00:06:21,564 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40519,1689984379684] 2023-07-22 00:06:21,567 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43309,1689984379801] 2023-07-22 00:06:21,566 DEBUG [RS:2;jenkins-hbase4:43309] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/WALs/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:21,565 INFO [RS:0;jenkins-hbase4:40519] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 00:06:21,567 DEBUG [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/WALs/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:21,593 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-22 00:06:21,596 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-22 00:06:21,596 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:06:21,601 DEBUG [RS:0;jenkins-hbase4:40519] zookeeper.ZKUtil(162): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:21,601 DEBUG [RS:2;jenkins-hbase4:43309] zookeeper.ZKUtil(162): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:21,602 DEBUG [RS:0;jenkins-hbase4:40519] zookeeper.ZKUtil(162): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:21,605 DEBUG [RS:2;jenkins-hbase4:43309] zookeeper.ZKUtil(162): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:21,623 DEBUG [RS:2;jenkins-hbase4:43309] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 00:06:21,629 DEBUG [RS:0;jenkins-hbase4:40519] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 00:06:21,641 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:21,643 INFO [RS:2;jenkins-hbase4:43309] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 00:06:21,643 INFO [RS:0;jenkins-hbase4:40519] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 00:06:21,648 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-22 00:06:21,651 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/info 2023-07-22 00:06:21,652 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-22 00:06:21,653 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:21,653 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-22 00:06:21,656 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/rep_barrier 2023-07-22 00:06:21,657 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-22 00:06:21,658 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:21,658 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-22 00:06:21,661 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/table 2023-07-22 00:06:21,663 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-22 00:06:21,661 INFO [RS:1;jenkins-hbase4:35499] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42695,1689984378224 with isa=jenkins-hbase4.apache.org/172.31.14.131:35499, startcode=1689984379745 2023-07-22 00:06:21,664 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:21,667 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740 2023-07-22 00:06:21,667 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42695] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:21,669 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740 2023-07-22 00:06:21,669 DEBUG [RS:1;jenkins-hbase4:35499] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:06:21,670 DEBUG [RS:1;jenkins-hbase4:35499] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34573 2023-07-22 00:06:21,670 DEBUG [RS:1;jenkins-hbase4:35499] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-22 00:06:21,672 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 00:06:21,672 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 00:06:21,672 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 00:06:21,673 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35499,1689984379745] 2023-07-22 00:06:21,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:21,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:21,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:21,680 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:21,680 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:21,681 DEBUG [RS:1;jenkins-hbase4:35499] zookeeper.ZKUtil(162): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:21,681 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:21,681 WARN [RS:1;jenkins-hbase4:35499] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-22 00:06:21,691 INFO [RS:1;jenkins-hbase4:35499] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 00:06:21,692 DEBUG [RS:1;jenkins-hbase4:35499] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/WALs/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:21,737 INFO [RS:2;jenkins-hbase4:43309] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 00:06:21,737 INFO [RS:0;jenkins-hbase4:40519] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 00:06:21,743 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-22 00:06:21,746 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-22 00:06:21,754 DEBUG [RS:1;jenkins-hbase4:35499] zookeeper.ZKUtil(162): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:21,755 DEBUG [RS:1;jenkins-hbase4:35499] zookeeper.ZKUtil(162): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:21,756 DEBUG [RS:1;jenkins-hbase4:35499] zookeeper.ZKUtil(162): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:21,757 DEBUG [RS:1;jenkins-hbase4:35499] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-22 00:06:21,758 INFO [RS:1;jenkins-hbase4:35499] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-22 00:06:21,762 INFO [RS:2;jenkins-hbase4:43309] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 00:06:21,762 INFO [RS:2;jenkins-hbase4:43309] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,770 INFO [RS:2;jenkins-hbase4:43309] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 00:06:21,762 INFO [RS:0;jenkins-hbase4:40519] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 00:06:21,775 INFO [RS:1;jenkins-hbase4:35499] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-22 00:06:21,775 INFO [RS:1;jenkins-hbase4:35499] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-22 00:06:21,773 INFO [RS:0;jenkins-hbase4:40519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,775 INFO [RS:1;jenkins-hbase4:35499] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,782 INFO [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 00:06:21,790 INFO [RS:1;jenkins-hbase4:35499] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-22 00:06:21,792 INFO [RS:2;jenkins-hbase4:43309] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,792 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:06:21,792 DEBUG [RS:2;jenkins-hbase4:43309] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,792 DEBUG [RS:2;jenkins-hbase4:43309] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,792 DEBUG [RS:2;jenkins-hbase4:43309] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,793 DEBUG [RS:2;jenkins-hbase4:43309] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,793 DEBUG [RS:2;jenkins-hbase4:43309] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,793 DEBUG [RS:2;jenkins-hbase4:43309] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 00:06:21,793 DEBUG [RS:2;jenkins-hbase4:43309] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,793 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59634286, jitterRate=-0.11137989163398743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-22 00:06:21,793 DEBUG [RS:2;jenkins-hbase4:43309] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,794 DEBUG [RS:2;jenkins-hbase4:43309] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,794 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-22 00:06:21,794 DEBUG [RS:2;jenkins-hbase4:43309] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,794 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-22 00:06:21,794 INFO [RS:1;jenkins-hbase4:35499] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,794 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-22 00:06:21,795 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-22 00:06:21,795 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-22 00:06:21,795 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-22 00:06:21,795 DEBUG [RS:1;jenkins-hbase4:35499] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,796 INFO [RS:2;jenkins-hbase4:43309] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,796 DEBUG [RS:1;jenkins-hbase4:35499] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,796 INFO [RS:2;jenkins-hbase4:43309] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,796 DEBUG [RS:1;jenkins-hbase4:35499] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,796 INFO [RS:2;jenkins-hbase4:43309] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,796 DEBUG [RS:1;jenkins-hbase4:35499] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,796 INFO [RS:0;jenkins-hbase4:40519] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,796 DEBUG [RS:1;jenkins-hbase4:35499] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,797 DEBUG [RS:1;jenkins-hbase4:35499] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 00:06:21,797 DEBUG [RS:1;jenkins-hbase4:35499] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,797 DEBUG [RS:1;jenkins-hbase4:35499] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,797 DEBUG [RS:1;jenkins-hbase4:35499] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,797 DEBUG [RS:1;jenkins-hbase4:35499] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,803 DEBUG [RS:0;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,803 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-22 00:06:21,803 DEBUG [RS:0;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,803 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-22 00:06:21,803 DEBUG [RS:0;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,803 DEBUG [RS:0;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,804 DEBUG [RS:0;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,804 DEBUG [RS:0;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-22 00:06:21,804 INFO [RS:1;jenkins-hbase4:35499] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,811 INFO [RS:1;jenkins-hbase4:35499] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,811 INFO [RS:1;jenkins-hbase4:35499] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,811 DEBUG [RS:0;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,811 DEBUG [RS:0;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,811 DEBUG [RS:0;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,811 DEBUG [RS:0;jenkins-hbase4:40519] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-22 00:06:21,817 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-22 00:06:21,817 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-22 00:06:21,823 INFO [RS:0;jenkins-hbase4:40519] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,823 INFO [RS:0;jenkins-hbase4:40519] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,824 INFO [RS:0;jenkins-hbase4:40519] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,832 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-22 00:06:21,836 INFO [RS:2;jenkins-hbase4:43309] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 00:06:21,850 INFO [RS:2;jenkins-hbase4:43309] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43309,1689984379801-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,852 INFO [RS:1;jenkins-hbase4:35499] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 00:06:21,863 INFO [RS:1;jenkins-hbase4:35499] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35499,1689984379745-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,890 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-22 00:06:21,900 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-22 00:06:21,908 INFO [RS:0;jenkins-hbase4:40519] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-22 00:06:21,908 INFO [RS:0;jenkins-hbase4:40519] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40519,1689984379684-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:21,925 INFO [RS:1;jenkins-hbase4:35499] regionserver.Replication(203): jenkins-hbase4.apache.org,35499,1689984379745 started 2023-07-22 00:06:21,925 INFO [RS:1;jenkins-hbase4:35499] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35499,1689984379745, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35499, sessionid=0x1018a59a4ce0002 2023-07-22 00:06:21,925 INFO [RS:2;jenkins-hbase4:43309] regionserver.Replication(203): jenkins-hbase4.apache.org,43309,1689984379801 started 2023-07-22 00:06:21,925 INFO [RS:2;jenkins-hbase4:43309] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43309,1689984379801, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43309, sessionid=0x1018a59a4ce0003 2023-07-22 00:06:21,925 DEBUG [RS:1;jenkins-hbase4:35499] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 00:06:21,926 DEBUG [RS:2;jenkins-hbase4:43309] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 00:06:21,926 DEBUG [RS:1;jenkins-hbase4:35499] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:21,926 INFO [RS:0;jenkins-hbase4:40519] regionserver.Replication(203): jenkins-hbase4.apache.org,40519,1689984379684 started 2023-07-22 00:06:21,926 DEBUG [RS:2;jenkins-hbase4:43309] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:21,927 DEBUG [RS:2;jenkins-hbase4:43309] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43309,1689984379801' 2023-07-22 00:06:21,927 DEBUG [RS:2;jenkins-hbase4:43309] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 00:06:21,926 DEBUG [RS:1;jenkins-hbase4:35499] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35499,1689984379745' 2023-07-22 00:06:21,928 DEBUG [RS:1;jenkins-hbase4:35499] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 00:06:21,927 INFO [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40519,1689984379684, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40519, sessionid=0x1018a59a4ce0001 2023-07-22 00:06:21,928 DEBUG [RS:0;jenkins-hbase4:40519] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-22 00:06:21,928 DEBUG [RS:0;jenkins-hbase4:40519] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:21,928 DEBUG [RS:0;jenkins-hbase4:40519] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40519,1689984379684' 2023-07-22 00:06:21,928 DEBUG [RS:0;jenkins-hbase4:40519] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-22 00:06:21,928 DEBUG [RS:1;jenkins-hbase4:35499] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 00:06:21,929 DEBUG [RS:0;jenkins-hbase4:40519] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 00:06:21,929 DEBUG [RS:1;jenkins-hbase4:35499] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 00:06:21,930 DEBUG [RS:0;jenkins-hbase4:40519] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 00:06:21,930 DEBUG [RS:1;jenkins-hbase4:35499] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 00:06:21,930 DEBUG [RS:0;jenkins-hbase4:40519] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 00:06:21,930 DEBUG [RS:1;jenkins-hbase4:35499] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:21,930 DEBUG [RS:0;jenkins-hbase4:40519] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:21,931 DEBUG [RS:1;jenkins-hbase4:35499] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35499,1689984379745' 2023-07-22 00:06:21,931 DEBUG [RS:1;jenkins-hbase4:35499] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:21,931 DEBUG [RS:0;jenkins-hbase4:40519] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40519,1689984379684' 2023-07-22 00:06:21,931 DEBUG [RS:0;jenkins-hbase4:40519] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:21,932 DEBUG [RS:1;jenkins-hbase4:35499] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:21,932 DEBUG [RS:0;jenkins-hbase4:40519] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:21,933 DEBUG [RS:1;jenkins-hbase4:35499] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 00:06:21,933 DEBUG [RS:0;jenkins-hbase4:40519] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 00:06:21,933 INFO [RS:1;jenkins-hbase4:35499] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 00:06:21,933 INFO [RS:0;jenkins-hbase4:40519] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 00:06:21,933 INFO [RS:1;jenkins-hbase4:35499] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 00:06:21,933 INFO [RS:0;jenkins-hbase4:40519] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 00:06:21,935 DEBUG [RS:2;jenkins-hbase4:43309] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-22 00:06:21,936 DEBUG [RS:2;jenkins-hbase4:43309] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-22 00:06:21,936 DEBUG [RS:2;jenkins-hbase4:43309] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-22 00:06:21,936 DEBUG [RS:2;jenkins-hbase4:43309] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:21,936 DEBUG [RS:2;jenkins-hbase4:43309] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43309,1689984379801' 2023-07-22 00:06:21,936 DEBUG [RS:2;jenkins-hbase4:43309] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:21,937 DEBUG [RS:2;jenkins-hbase4:43309] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:21,937 DEBUG [RS:2;jenkins-hbase4:43309] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-22 00:06:21,937 INFO [RS:2;jenkins-hbase4:43309] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-22 00:06:21,937 INFO [RS:2;jenkins-hbase4:43309] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-22 00:06:22,050 INFO [RS:1;jenkins-hbase4:35499] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35499%2C1689984379745, suffix=, logDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/WALs/jenkins-hbase4.apache.org,35499,1689984379745, archiveDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/oldWALs, maxLogs=32 2023-07-22 00:06:22,050 INFO [RS:0;jenkins-hbase4:40519] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40519%2C1689984379684, suffix=, logDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/WALs/jenkins-hbase4.apache.org,40519,1689984379684, archiveDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/oldWALs, maxLogs=32 2023-07-22 00:06:22,056 INFO [RS:2;jenkins-hbase4:43309] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43309%2C1689984379801, suffix=, logDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/WALs/jenkins-hbase4.apache.org,43309,1689984379801, archiveDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/oldWALs, maxLogs=32 2023-07-22 00:06:22,056 DEBUG [jenkins-hbase4:42695] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-22 00:06:22,062 DEBUG [jenkins-hbase4:42695] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:06:22,070 DEBUG [jenkins-hbase4:42695] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:06:22,070 DEBUG [jenkins-hbase4:42695] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:06:22,070 DEBUG [jenkins-hbase4:42695] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:06:22,070 DEBUG [jenkins-hbase4:42695] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:06:22,076 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40519,1689984379684, state=OPENING 2023-07-22 00:06:22,087 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-22 00:06:22,091 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:22,092 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-22 00:06:22,108 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40519,1689984379684}] 2023-07-22 00:06:22,116 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44275,DS-090716f8-f0ae-4891-aa75-3281275f526c,DISK] 2023-07-22 00:06:22,116 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44375,DS-d96c6b5e-bb13-4dff-b20c-1c61bf3daca3,DISK] 2023-07-22 00:06:22,116 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34293,DS-3d236351-a1c1-432c-a701-2c8bbfdf088c,DISK] 2023-07-22 00:06:22,119 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44275,DS-090716f8-f0ae-4891-aa75-3281275f526c,DISK] 2023-07-22 00:06:22,120 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34293,DS-3d236351-a1c1-432c-a701-2c8bbfdf088c,DISK] 2023-07-22 00:06:22,120 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44375,DS-d96c6b5e-bb13-4dff-b20c-1c61bf3daca3,DISK] 2023-07-22 00:06:22,130 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44375,DS-d96c6b5e-bb13-4dff-b20c-1c61bf3daca3,DISK] 2023-07-22 00:06:22,130 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44275,DS-090716f8-f0ae-4891-aa75-3281275f526c,DISK] 2023-07-22 00:06:22,130 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34293,DS-3d236351-a1c1-432c-a701-2c8bbfdf088c,DISK] 2023-07-22 00:06:22,160 INFO [RS:0;jenkins-hbase4:40519] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/WALs/jenkins-hbase4.apache.org,40519,1689984379684/jenkins-hbase4.apache.org%2C40519%2C1689984379684.1689984382055 2023-07-22 00:06:22,161 INFO [RS:1;jenkins-hbase4:35499] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/WALs/jenkins-hbase4.apache.org,35499,1689984379745/jenkins-hbase4.apache.org%2C35499%2C1689984379745.1689984382055 2023-07-22 00:06:22,165 INFO [RS:2;jenkins-hbase4:43309] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/WALs/jenkins-hbase4.apache.org,43309,1689984379801/jenkins-hbase4.apache.org%2C43309%2C1689984379801.1689984382057 2023-07-22 00:06:22,166 DEBUG [RS:0;jenkins-hbase4:40519] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44275,DS-090716f8-f0ae-4891-aa75-3281275f526c,DISK], DatanodeInfoWithStorage[127.0.0.1:44375,DS-d96c6b5e-bb13-4dff-b20c-1c61bf3daca3,DISK], DatanodeInfoWithStorage[127.0.0.1:34293,DS-3d236351-a1c1-432c-a701-2c8bbfdf088c,DISK]] 2023-07-22 00:06:22,170 DEBUG [RS:1;jenkins-hbase4:35499] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44375,DS-d96c6b5e-bb13-4dff-b20c-1c61bf3daca3,DISK], DatanodeInfoWithStorage[127.0.0.1:34293,DS-3d236351-a1c1-432c-a701-2c8bbfdf088c,DISK], DatanodeInfoWithStorage[127.0.0.1:44275,DS-090716f8-f0ae-4891-aa75-3281275f526c,DISK]] 2023-07-22 00:06:22,170 DEBUG [RS:2;jenkins-hbase4:43309] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34293,DS-3d236351-a1c1-432c-a701-2c8bbfdf088c,DISK], DatanodeInfoWithStorage[127.0.0.1:44275,DS-090716f8-f0ae-4891-aa75-3281275f526c,DISK], DatanodeInfoWithStorage[127.0.0.1:44375,DS-d96c6b5e-bb13-4dff-b20c-1c61bf3daca3,DISK]] 2023-07-22 00:06:22,330 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:22,333 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 00:06:22,336 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 00:06:22,352 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-22 00:06:22,352 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-22 00:06:22,357 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40519%2C1689984379684.meta, suffix=.meta, logDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/WALs/jenkins-hbase4.apache.org,40519,1689984379684, archiveDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/oldWALs, maxLogs=32 2023-07-22 00:06:22,401 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44275,DS-090716f8-f0ae-4891-aa75-3281275f526c,DISK] 2023-07-22 00:06:22,403 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34293,DS-3d236351-a1c1-432c-a701-2c8bbfdf088c,DISK] 2023-07-22 00:06:22,414 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44375,DS-d96c6b5e-bb13-4dff-b20c-1c61bf3daca3,DISK] 2023-07-22 00:06:22,426 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/WALs/jenkins-hbase4.apache.org,40519,1689984379684/jenkins-hbase4.apache.org%2C40519%2C1689984379684.meta.1689984382358.meta 2023-07-22 00:06:22,429 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44275,DS-090716f8-f0ae-4891-aa75-3281275f526c,DISK], DatanodeInfoWithStorage[127.0.0.1:34293,DS-3d236351-a1c1-432c-a701-2c8bbfdf088c,DISK], DatanodeInfoWithStorage[127.0.0.1:44375,DS-d96c6b5e-bb13-4dff-b20c-1c61bf3daca3,DISK]] 2023-07-22 00:06:22,429 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-22 00:06:22,432 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-22 00:06:22,435 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:22,436 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-22 00:06:22,438 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-22 00:06:22,440 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-22 00:06:22,458 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-22 00:06:22,458 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:22,458 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-22 00:06:22,458 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-22 00:06:22,463 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-22 00:06:22,466 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/info 2023-07-22 00:06:22,466 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/info 2023-07-22 00:06:22,467 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-22 00:06:22,470 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:22,471 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-22 00:06:22,472 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/rep_barrier 2023-07-22 00:06:22,472 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/rep_barrier 2023-07-22 00:06:22,473 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-22 00:06:22,474 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:22,474 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-22 00:06:22,476 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/table 2023-07-22 00:06:22,476 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/table 2023-07-22 00:06:22,477 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-22 00:06:22,478 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:22,481 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740 2023-07-22 00:06:22,484 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740 2023-07-22 00:06:22,488 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-22 00:06:22,490 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-22 00:06:22,492 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74000009, jitterRate=0.10268606245517731}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-22 00:06:22,495 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-22 00:06:22,518 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689984382321 2023-07-22 00:06:22,562 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40519,1689984379684, state=OPEN 2023-07-22 00:06:22,567 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-22 00:06:22,568 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-22 00:06:22,571 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-22 00:06:22,572 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-22 00:06:22,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-22 00:06:22,578 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40519,1689984379684 in 464 msec 2023-07-22 00:06:22,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-22 00:06:22,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 748 msec 2023-07-22 00:06:22,599 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3070 sec 2023-07-22 00:06:22,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689984382600, completionTime=-1 2023-07-22 00:06:22,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-22 00:06:22,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-22 00:06:22,684 DEBUG [hconnection-0x48dedf1b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:22,689 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43908, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:22,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-22 00:06:22,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689984442717 2023-07-22 00:06:22,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689984502717 2023-07-22 00:06:22,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 116 msec 2023-07-22 00:06:22,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42695,1689984378224-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:22,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42695,1689984378224-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:22,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42695,1689984378224-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:22,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42695, period=300000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:22,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-22 00:06:22,764 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-22 00:06:22,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-22 00:06:22,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 00:06:22,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-22 00:06:22,789 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:06:22,792 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:06:22,818 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/hbase/namespace/7a25471be2b1178d4a02da04fc0f1b60 2023-07-22 00:06:22,821 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/hbase/namespace/7a25471be2b1178d4a02da04fc0f1b60 empty. 2023-07-22 00:06:22,822 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/hbase/namespace/7a25471be2b1178d4a02da04fc0f1b60 2023-07-22 00:06:22,822 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-22 00:06:22,866 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-22 00:06:22,869 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7a25471be2b1178d4a02da04fc0f1b60, NAME => 'hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp 2023-07-22 00:06:22,897 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:22,898 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 7a25471be2b1178d4a02da04fc0f1b60, disabling compactions & flushes 2023-07-22 00:06:22,898 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60. 2023-07-22 00:06:22,898 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60. 2023-07-22 00:06:22,898 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60. after waiting 0 ms 2023-07-22 00:06:22,898 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60. 2023-07-22 00:06:22,898 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60. 2023-07-22 00:06:22,898 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 7a25471be2b1178d4a02da04fc0f1b60: 2023-07-22 00:06:22,904 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:06:22,925 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689984382908"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984382908"}]},"ts":"1689984382908"} 2023-07-22 00:06:22,958 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 00:06:22,960 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:06:22,964 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984382960"}]},"ts":"1689984382960"} 2023-07-22 00:06:22,970 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-22 00:06:22,975 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:06:22,977 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:06:22,977 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:06:22,977 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:06:22,977 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:06:22,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7a25471be2b1178d4a02da04fc0f1b60, ASSIGN}] 2023-07-22 00:06:22,984 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7a25471be2b1178d4a02da04fc0f1b60, ASSIGN 2023-07-22 00:06:22,986 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7a25471be2b1178d4a02da04fc0f1b60, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40519,1689984379684; forceNewPlan=false, retain=false 2023-07-22 00:06:23,138 INFO [jenkins-hbase4:42695] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 00:06:23,139 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7a25471be2b1178d4a02da04fc0f1b60, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:23,140 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689984383139"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984383139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984383139"}]},"ts":"1689984383139"} 2023-07-22 00:06:23,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7a25471be2b1178d4a02da04fc0f1b60, server=jenkins-hbase4.apache.org,40519,1689984379684}] 2023-07-22 00:06:23,313 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60. 2023-07-22 00:06:23,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7a25471be2b1178d4a02da04fc0f1b60, NAME => 'hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60.', STARTKEY => '', ENDKEY => ''} 2023-07-22 00:06:23,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60. service=AccessControlService 2023-07-22 00:06:23,315 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:23,316 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7a25471be2b1178d4a02da04fc0f1b60 2023-07-22 00:06:23,316 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:23,316 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7a25471be2b1178d4a02da04fc0f1b60 2023-07-22 00:06:23,316 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7a25471be2b1178d4a02da04fc0f1b60 2023-07-22 00:06:23,319 INFO [StoreOpener-7a25471be2b1178d4a02da04fc0f1b60-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7a25471be2b1178d4a02da04fc0f1b60 2023-07-22 00:06:23,321 DEBUG [StoreOpener-7a25471be2b1178d4a02da04fc0f1b60-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/namespace/7a25471be2b1178d4a02da04fc0f1b60/info 2023-07-22 00:06:23,321 DEBUG [StoreOpener-7a25471be2b1178d4a02da04fc0f1b60-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/namespace/7a25471be2b1178d4a02da04fc0f1b60/info 2023-07-22 00:06:23,322 INFO [StoreOpener-7a25471be2b1178d4a02da04fc0f1b60-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a25471be2b1178d4a02da04fc0f1b60 columnFamilyName info 2023-07-22 00:06:23,323 INFO [StoreOpener-7a25471be2b1178d4a02da04fc0f1b60-1] regionserver.HStore(310): Store=7a25471be2b1178d4a02da04fc0f1b60/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:23,325 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/namespace/7a25471be2b1178d4a02da04fc0f1b60 2023-07-22 00:06:23,327 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/namespace/7a25471be2b1178d4a02da04fc0f1b60 2023-07-22 00:06:23,332 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7a25471be2b1178d4a02da04fc0f1b60 2023-07-22 00:06:23,338 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/namespace/7a25471be2b1178d4a02da04fc0f1b60/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:06:23,339 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7a25471be2b1178d4a02da04fc0f1b60; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66134211, jitterRate=-0.0145234614610672}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:06:23,339 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7a25471be2b1178d4a02da04fc0f1b60: 2023-07-22 00:06:23,341 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60., pid=6, masterSystemTime=1689984383304 2023-07-22 00:06:23,348 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60. 2023-07-22 00:06:23,348 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60. 2023-07-22 00:06:23,350 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7a25471be2b1178d4a02da04fc0f1b60, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:23,350 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689984383349"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984383349"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984383349"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984383349"}]},"ts":"1689984383349"} 2023-07-22 00:06:23,365 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-22 00:06:23,365 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7a25471be2b1178d4a02da04fc0f1b60, server=jenkins-hbase4.apache.org,40519,1689984379684 in 205 msec 2023-07-22 00:06:23,381 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-22 00:06:23,382 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7a25471be2b1178d4a02da04fc0f1b60, ASSIGN in 385 msec 2023-07-22 00:06:23,384 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:06:23,384 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984383384"}]},"ts":"1689984383384"} 2023-07-22 00:06:23,388 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-22 00:06:23,391 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:06:23,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-22 00:06:23,396 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-22 00:06:23,396 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:23,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 615 msec 2023-07-22 00:06:23,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-22 00:06:23,463 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-22 00:06:23,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 42 msec 2023-07-22 00:06:23,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-22 00:06:23,506 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-22 00:06:23,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 33 msec 2023-07-22 00:06:23,532 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-22 00:06:23,536 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-22 00:06:23,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.652sec 2023-07-22 00:06:23,541 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-22 00:06:23,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-22 00:06:23,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-22 00:06:23,544 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42695,1689984378224-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-22 00:06:23,546 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42695,1689984378224-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-22 00:06:23,566 DEBUG [Listener at localhost/38513] zookeeper.ReadOnlyZKClient(139): Connect 0x68214c6c to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:23,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-22 00:06:23,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-22 00:06:23,580 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:06:23,582 DEBUG [Listener at localhost/38513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@504158e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:23,587 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:06:23,593 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/hbase/acl/7da5bf6a3203bfd27ef0fd7fabfa8b94 2023-07-22 00:06:23,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-22 00:06:23,594 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/hbase/acl/7da5bf6a3203bfd27ef0fd7fabfa8b94 empty. 2023-07-22 00:06:23,600 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/hbase/acl/7da5bf6a3203bfd27ef0fd7fabfa8b94 2023-07-22 00:06:23,600 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-22 00:06:23,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 00:06:23,609 DEBUG [hconnection-0x290efef4-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:23,631 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:23,642 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42695,1689984378224 2023-07-22 00:06:23,642 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-22 00:06:23,643 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/test.cache.data in system properties and HBase conf 2023-07-22 00:06:23,643 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/hadoop.tmp.dir in system properties and HBase conf 2023-07-22 00:06:23,643 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/hadoop.log.dir in system properties and HBase conf 2023-07-22 00:06:23,643 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-22 00:06:23,643 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-22 00:06:23,643 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-22 00:06:23,644 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-22 00:06:23,644 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-22 00:06:23,644 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-22 00:06:23,644 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 00:06:23,644 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-22 00:06:23,644 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-22 00:06:23,644 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-22 00:06:23,644 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 00:06:23,645 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-22 00:06:23,645 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/nfs.dump.dir in system properties and HBase conf 2023-07-22 00:06:23,645 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/java.io.tmpdir in system properties and HBase conf 2023-07-22 00:06:23,645 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-22 00:06:23,645 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-22 00:06:23,645 INFO [Listener at localhost/38513] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-22 00:06:23,668 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-22 00:06:23,670 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7da5bf6a3203bfd27ef0fd7fabfa8b94, NAME => 'hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp 2023-07-22 00:06:23,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 00:06:23,713 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:23,714 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 7da5bf6a3203bfd27ef0fd7fabfa8b94, disabling compactions & flushes 2023-07-22 00:06:23,714 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94. 2023-07-22 00:06:23,714 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94. 2023-07-22 00:06:23,715 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94. after waiting 0 ms 2023-07-22 00:06:23,715 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94. 2023-07-22 00:06:23,715 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94. 2023-07-22 00:06:23,715 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 7da5bf6a3203bfd27ef0fd7fabfa8b94: 2023-07-22 00:06:23,721 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:06:23,723 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689984383722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984383722"}]},"ts":"1689984383722"} 2023-07-22 00:06:23,726 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-22 00:06:23,732 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:06:23,732 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984383732"}]},"ts":"1689984383732"} 2023-07-22 00:06:23,736 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-22 00:06:23,741 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:06:23,748 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:06:23,748 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:06:23,748 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:06:23,748 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:06:23,748 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=7da5bf6a3203bfd27ef0fd7fabfa8b94, ASSIGN}] 2023-07-22 00:06:23,765 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=7da5bf6a3203bfd27ef0fd7fabfa8b94, ASSIGN 2023-07-22 00:06:23,767 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=7da5bf6a3203bfd27ef0fd7fabfa8b94, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40519,1689984379684; forceNewPlan=false, retain=false 2023-07-22 00:06:23,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 00:06:23,918 INFO [jenkins-hbase4:42695] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 00:06:23,920 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7da5bf6a3203bfd27ef0fd7fabfa8b94, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:23,920 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689984383919"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984383919"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984383919"}]},"ts":"1689984383919"} 2023-07-22 00:06:23,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 7da5bf6a3203bfd27ef0fd7fabfa8b94, server=jenkins-hbase4.apache.org,40519,1689984379684}] 2023-07-22 00:06:24,087 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94. 2023-07-22 00:06:24,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7da5bf6a3203bfd27ef0fd7fabfa8b94, NAME => 'hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94.', STARTKEY => '', ENDKEY => ''} 2023-07-22 00:06:24,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94. service=AccessControlService 2023-07-22 00:06:24,088 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:24,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 7da5bf6a3203bfd27ef0fd7fabfa8b94 2023-07-22 00:06:24,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:24,089 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7da5bf6a3203bfd27ef0fd7fabfa8b94 2023-07-22 00:06:24,089 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7da5bf6a3203bfd27ef0fd7fabfa8b94 2023-07-22 00:06:24,092 INFO [StoreOpener-7da5bf6a3203bfd27ef0fd7fabfa8b94-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 7da5bf6a3203bfd27ef0fd7fabfa8b94 2023-07-22 00:06:24,096 DEBUG [StoreOpener-7da5bf6a3203bfd27ef0fd7fabfa8b94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/acl/7da5bf6a3203bfd27ef0fd7fabfa8b94/l 2023-07-22 00:06:24,096 DEBUG [StoreOpener-7da5bf6a3203bfd27ef0fd7fabfa8b94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/acl/7da5bf6a3203bfd27ef0fd7fabfa8b94/l 2023-07-22 00:06:24,097 INFO [StoreOpener-7da5bf6a3203bfd27ef0fd7fabfa8b94-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7da5bf6a3203bfd27ef0fd7fabfa8b94 columnFamilyName l 2023-07-22 00:06:24,102 INFO [StoreOpener-7da5bf6a3203bfd27ef0fd7fabfa8b94-1] regionserver.HStore(310): Store=7da5bf6a3203bfd27ef0fd7fabfa8b94/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:24,105 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/acl/7da5bf6a3203bfd27ef0fd7fabfa8b94 2023-07-22 00:06:24,106 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/acl/7da5bf6a3203bfd27ef0fd7fabfa8b94 2023-07-22 00:06:24,113 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7da5bf6a3203bfd27ef0fd7fabfa8b94 2023-07-22 00:06:24,116 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/acl/7da5bf6a3203bfd27ef0fd7fabfa8b94/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:06:24,117 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7da5bf6a3203bfd27ef0fd7fabfa8b94; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69683231, jitterRate=0.03836105763912201}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:06:24,118 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7da5bf6a3203bfd27ef0fd7fabfa8b94: 2023-07-22 00:06:24,120 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94., pid=11, masterSystemTime=1689984384079 2023-07-22 00:06:24,123 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94. 2023-07-22 00:06:24,123 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94. 2023-07-22 00:06:24,126 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7da5bf6a3203bfd27ef0fd7fabfa8b94, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:24,127 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689984384126"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984384126"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984384126"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984384126"}]},"ts":"1689984384126"} 2023-07-22 00:06:24,134 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-22 00:06:24,134 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 7da5bf6a3203bfd27ef0fd7fabfa8b94, server=jenkins-hbase4.apache.org,40519,1689984379684 in 206 msec 2023-07-22 00:06:24,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-22 00:06:24,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=7da5bf6a3203bfd27ef0fd7fabfa8b94, ASSIGN in 387 msec 2023-07-22 00:06:24,140 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:06:24,140 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984384140"}]},"ts":"1689984384140"} 2023-07-22 00:06:24,143 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-22 00:06:24,148 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:06:24,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 575 msec 2023-07-22 00:06:24,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-22 00:06:24,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-22 00:06:24,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-22 00:06:24,922 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 00:06:25,263 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 00:06:25,279 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42079_jobhistory____.rdjnk3/webapp 2023-07-22 00:06:25,441 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-22 00:06:25,441 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-22 00:06:25,441 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 00:06:25,444 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 00:06:25,512 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:25,821 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:26,237 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-22 00:06:26,279 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42079 2023-07-22 00:06:27,908 WARN [Listener at jenkins-hbase4.apache.org/33727] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 00:06:28,211 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 00:06:28,308 WARN [Listener at jenkins-hbase4.apache.org/33727] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 00:06:28,309 INFO [Listener at jenkins-hbase4.apache.org/33727] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 00:06:28,330 INFO [Listener at jenkins-hbase4.apache.org/33727] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45625_cluster____.sq1oac/webapp 2023-07-22 00:06:28,360 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-22 00:06:28,362 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-22 00:06:28,363 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-22 00:06:28,401 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:06:28,401 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-22 00:06:28,402 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:06:28,402 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-22 00:06:28,402 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-22 00:06:28,402 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-22 00:06:28,402 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:06:28,402 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-22 00:06:28,402 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-22 00:06:28,402 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-22 00:06:28,424 INFO [Listener at jenkins-hbase4.apache.org/33727] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 00:06:28,425 INFO [Listener at jenkins-hbase4.apache.org/33727] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-22 00:06:28,425 INFO [Listener at jenkins-hbase4.apache.org/33727] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 00:06:28,425 INFO [Listener at jenkins-hbase4.apache.org/33727] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 00:06:28,438 INFO [Listener at jenkins-hbase4.apache.org/33727] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:28,656 INFO [Listener at jenkins-hbase4.apache.org/33727] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:28,744 INFO [Listener at jenkins-hbase4.apache.org/33727] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:28,756 INFO [Listener at jenkins-hbase4.apache.org/33727] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45625 2023-07-22 00:06:29,144 WARN [Listener at jenkins-hbase4.apache.org/42893] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 00:06:29,170 WARN [Listener at jenkins-hbase4.apache.org/42893] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 00:06:29,170 INFO [Listener at jenkins-hbase4.apache.org/42893] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 00:06:29,179 INFO [Listener at jenkins-hbase4.apache.org/42893] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34969_node____1gmp6h/webapp 2023-07-22 00:06:29,232 INFO [Listener at jenkins-hbase4.apache.org/42893] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-22 00:06:29,233 INFO [Listener at jenkins-hbase4.apache.org/42893] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 00:06:29,233 INFO [Listener at jenkins-hbase4.apache.org/42893] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 00:06:29,233 INFO [Listener at jenkins-hbase4.apache.org/42893] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 00:06:29,241 INFO [Listener at jenkins-hbase4.apache.org/42893] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:29,262 INFO [Listener at jenkins-hbase4.apache.org/42893] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:29,340 INFO [Listener at jenkins-hbase4.apache.org/42893] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:29,359 INFO [Listener at jenkins-hbase4.apache.org/42893] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34969 2023-07-22 00:06:29,512 WARN [Listener at jenkins-hbase4.apache.org/40445] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-22 00:06:29,519 WARN [Listener at jenkins-hbase4.apache.org/40445] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-22 00:06:29,520 INFO [Listener at jenkins-hbase4.apache.org/40445] log.Slf4jLog(67): jetty-6.1.26 2023-07-22 00:06:29,527 INFO [Listener at jenkins-hbase4.apache.org/40445] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45541_node____83k70v/webapp 2023-07-22 00:06:29,581 INFO [Listener at jenkins-hbase4.apache.org/40445] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-22 00:06:29,582 INFO [Listener at jenkins-hbase4.apache.org/40445] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-22 00:06:29,582 INFO [Listener at jenkins-hbase4.apache.org/40445] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-22 00:06:29,582 INFO [Listener at jenkins-hbase4.apache.org/40445] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-22 00:06:29,588 INFO [Listener at jenkins-hbase4.apache.org/40445] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:29,607 INFO [Listener at jenkins-hbase4.apache.org/40445] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:29,684 INFO [Listener at jenkins-hbase4.apache.org/40445] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-22 00:06:29,696 INFO [Listener at jenkins-hbase4.apache.org/40445] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45541 2023-07-22 00:06:29,752 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-22 00:06:29,755 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:06:29,846 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=271, ProcessCount=172, AvailableMemoryMB=9339 2023-07-22 00:06:29,846 WARN [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-07-22 00:06:29,863 DEBUG [Listener at jenkins-hbase4.apache.org/40445] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-22 00:06:29,872 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-22 00:06:29,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 00:06:29,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-22 00:06:29,895 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:06:29,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-22 00:06:29,897 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:06:29,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 00:06:29,902 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b 2023-07-22 00:06:29,903 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172 2023-07-22 00:06:29,903 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b empty. 2023-07-22 00:06:29,905 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172 empty. 2023-07-22 00:06:29,907 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b 2023-07-22 00:06:29,908 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172 2023-07-22 00:06:29,908 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-22 00:06:29,948 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-22 00:06:29,950 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 87b455af543ad9b924432665f2eee14b, NAME => 'testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp 2023-07-22 00:06:29,950 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 58c97dc894529e6ced4482f479199172, NAME => 'testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp 2023-07-22 00:06:29,984 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:29,984 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:29,985 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 87b455af543ad9b924432665f2eee14b, disabling compactions & flushes 2023-07-22 00:06:29,985 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 58c97dc894529e6ced4482f479199172, disabling compactions & flushes 2023-07-22 00:06:29,985 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. 2023-07-22 00:06:29,985 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. 2023-07-22 00:06:29,985 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. 2023-07-22 00:06:29,985 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. 2023-07-22 00:06:29,985 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. after waiting 0 ms 2023-07-22 00:06:29,985 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. after waiting 0 ms 2023-07-22 00:06:29,986 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. 2023-07-22 00:06:29,986 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. 2023-07-22 00:06:29,986 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. 2023-07-22 00:06:29,986 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. 2023-07-22 00:06:29,986 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 87b455af543ad9b924432665f2eee14b: 2023-07-22 00:06:29,986 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 58c97dc894529e6ced4482f479199172: 2023-07-22 00:06:29,990 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:06:29,991 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984389991"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984389991"}]},"ts":"1689984389991"} 2023-07-22 00:06:29,991 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984389991"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984389991"}]},"ts":"1689984389991"} 2023-07-22 00:06:30,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 00:06:30,056 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 00:06:30,058 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:06:30,059 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984390058"}]},"ts":"1689984390058"} 2023-07-22 00:06:30,061 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-22 00:06:30,067 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:06:30,070 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:06:30,070 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:06:30,070 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:06:30,070 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:06:30,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=87b455af543ad9b924432665f2eee14b, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=58c97dc894529e6ced4482f479199172, ASSIGN}] 2023-07-22 00:06:30,075 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=58c97dc894529e6ced4482f479199172, ASSIGN 2023-07-22 00:06:30,075 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=87b455af543ad9b924432665f2eee14b, ASSIGN 2023-07-22 00:06:30,077 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=58c97dc894529e6ced4482f479199172, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43309,1689984379801; forceNewPlan=false, retain=false 2023-07-22 00:06:30,077 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=87b455af543ad9b924432665f2eee14b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40519,1689984379684; forceNewPlan=false, retain=false 2023-07-22 00:06:30,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 00:06:30,227 INFO [jenkins-hbase4:42695] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 00:06:30,230 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=58c97dc894529e6ced4482f479199172, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:30,230 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=87b455af543ad9b924432665f2eee14b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:30,230 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984390230"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984390230"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984390230"}]},"ts":"1689984390230"} 2023-07-22 00:06:30,230 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984390230"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984390230"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984390230"}]},"ts":"1689984390230"} 2023-07-22 00:06:30,233 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 87b455af543ad9b924432665f2eee14b, server=jenkins-hbase4.apache.org,40519,1689984379684}] 2023-07-22 00:06:30,235 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 58c97dc894529e6ced4482f479199172, server=jenkins-hbase4.apache.org,43309,1689984379801}] 2023-07-22 00:06:30,389 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:30,389 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 00:06:30,395 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 00:06:30,397 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. 2023-07-22 00:06:30,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87b455af543ad9b924432665f2eee14b, NAME => 'testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 00:06:30,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. service=AccessControlService 2023-07-22 00:06:30,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:30,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 87b455af543ad9b924432665f2eee14b 2023-07-22 00:06:30,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:30,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 87b455af543ad9b924432665f2eee14b 2023-07-22 00:06:30,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 87b455af543ad9b924432665f2eee14b 2023-07-22 00:06:30,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. 2023-07-22 00:06:30,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 58c97dc894529e6ced4482f479199172, NAME => 'testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 00:06:30,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. service=AccessControlService 2023-07-22 00:06:30,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:30,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 58c97dc894529e6ced4482f479199172 2023-07-22 00:06:30,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:30,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 58c97dc894529e6ced4482f479199172 2023-07-22 00:06:30,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 58c97dc894529e6ced4482f479199172 2023-07-22 00:06:30,407 INFO [StoreOpener-87b455af543ad9b924432665f2eee14b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 87b455af543ad9b924432665f2eee14b 2023-07-22 00:06:30,409 INFO [StoreOpener-58c97dc894529e6ced4482f479199172-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 58c97dc894529e6ced4482f479199172 2023-07-22 00:06:30,410 DEBUG [StoreOpener-87b455af543ad9b924432665f2eee14b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b/cf 2023-07-22 00:06:30,410 DEBUG [StoreOpener-87b455af543ad9b924432665f2eee14b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b/cf 2023-07-22 00:06:30,410 INFO [StoreOpener-87b455af543ad9b924432665f2eee14b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87b455af543ad9b924432665f2eee14b columnFamilyName cf 2023-07-22 00:06:30,411 DEBUG [StoreOpener-58c97dc894529e6ced4482f479199172-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172/cf 2023-07-22 00:06:30,412 DEBUG [StoreOpener-58c97dc894529e6ced4482f479199172-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172/cf 2023-07-22 00:06:30,412 INFO [StoreOpener-87b455af543ad9b924432665f2eee14b-1] regionserver.HStore(310): Store=87b455af543ad9b924432665f2eee14b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:30,414 INFO [StoreOpener-58c97dc894529e6ced4482f479199172-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 58c97dc894529e6ced4482f479199172 columnFamilyName cf 2023-07-22 00:06:30,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b 2023-07-22 00:06:30,415 INFO [StoreOpener-58c97dc894529e6ced4482f479199172-1] regionserver.HStore(310): Store=58c97dc894529e6ced4482f479199172/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:30,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b 2023-07-22 00:06:30,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172 2023-07-22 00:06:30,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172 2023-07-22 00:06:30,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 58c97dc894529e6ced4482f479199172 2023-07-22 00:06:30,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:06:30,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 58c97dc894529e6ced4482f479199172; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60871838, jitterRate=-0.09293892979621887}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:06:30,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 58c97dc894529e6ced4482f479199172: 2023-07-22 00:06:30,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172., pid=16, masterSystemTime=1689984390389 2023-07-22 00:06:30,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 87b455af543ad9b924432665f2eee14b 2023-07-22 00:06:30,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. 2023-07-22 00:06:30,454 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=58c97dc894529e6ced4482f479199172, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:30,454 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984390453"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984390453"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984390453"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984390453"}]},"ts":"1689984390453"} 2023-07-22 00:06:30,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. 2023-07-22 00:06:30,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:06:30,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 87b455af543ad9b924432665f2eee14b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59180486, jitterRate=-0.1181420385837555}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:06:30,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 87b455af543ad9b924432665f2eee14b: 2023-07-22 00:06:30,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-22 00:06:30,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 58c97dc894529e6ced4482f479199172, server=jenkins-hbase4.apache.org,43309,1689984379801 in 226 msec 2023-07-22 00:06:30,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b., pid=15, masterSystemTime=1689984390386 2023-07-22 00:06:30,469 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=58c97dc894529e6ced4482f479199172, ASSIGN in 395 msec 2023-07-22 00:06:30,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. 2023-07-22 00:06:30,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. 2023-07-22 00:06:30,470 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=87b455af543ad9b924432665f2eee14b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:30,470 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984390470"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984390470"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984390470"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984390470"}]},"ts":"1689984390470"} 2023-07-22 00:06:30,476 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-22 00:06:30,477 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 87b455af543ad9b924432665f2eee14b, server=jenkins-hbase4.apache.org,40519,1689984379684 in 240 msec 2023-07-22 00:06:30,479 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-22 00:06:30,480 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:06:30,486 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=87b455af543ad9b924432665f2eee14b, ASSIGN in 406 msec 2023-07-22 00:06:30,487 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984390486"}]},"ts":"1689984390486"} 2023-07-22 00:06:30,489 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-22 00:06:30,495 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:06:30,501 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-22 00:06:30,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 00:06:30,530 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40519] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 00:06:30,564 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:30,564 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:30,564 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:30,564 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:30,564 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:06:30,571 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 00:06:30,571 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 00:06:30,571 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 00:06:30,571 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-22 00:06:30,575 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 691 msec 2023-07-22 00:06:31,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-22 00:06:31,007 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-22 00:06:31,007 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-22 00:06:31,008 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:06:31,013 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-22 00:06:31,014 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:06:31,014 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-22 00:06:31,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 00:06:31,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984391031 (current time:1689984391031). 2023-07-22 00:06:31,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:06:31,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x3aa83a3f to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:31,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f5239, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:31,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:31,044 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:31,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3aa83a3f to 127.0.0.1:58666 2023-07-22 00:06:31,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:06:31,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x55a582b7 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:31,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@375f2600, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:31,060 DEBUG [hconnection-0xe2594d7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:31,063 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:31,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55a582b7 to 127.0.0.1:58666 2023-07-22 00:06:31,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:06:31,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 00:06:31,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:06:31,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 00:06:31,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 00:06:31,125 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 00:06:31,127 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689984991127 2023-07-22 00:06:31,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 00:06:31,135 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-22 00:06:31,140 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 00:06:31,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 00:06:31,145 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 25 msec 2023-07-22 00:06:31,147 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 00:06:31,149 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:06:31,149 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:06:31,151 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689984991151 2023-07-22 00:06:31,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,180 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-22 00:06:31,180 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:31,182 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-22 00:06:31,182 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-22 00:06:31,182 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,182 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,189 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,189 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,189 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,189 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,190 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,190 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 00:06:31,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 00:06:31,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,193 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,193 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 00:06:31,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,193 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:06:31,195 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 00:06:31,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-22 00:06:31,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,195 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 00:06:31,196 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,199 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,199 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 00:06:31,199 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 00:06:31,199 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 00:06:31,199 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:31,199 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:31,201 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 00:06:31,199 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:31,202 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 00:06:31,203 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 00:06:31,203 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 00:06:31,202 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 00:06:31,203 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 00:06:31,203 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-22 00:06:31,203 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 00:06:31,203 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-22 00:06:31,205 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,205 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,207 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,207 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,207 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:31,207 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,207 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,207 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,207 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:31,207 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,208 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:31,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-22 00:06:31,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d0780d9[Count = 1] remaining members to acquire global barrier 2023-07-22 00:06:31,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-22 00:06:31,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d0780d9[Count = 0] remaining members to acquire global barrier 2023-07-22 00:06:31,213 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-22 00:06:31,214 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,216 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,216 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,216 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,217 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 00:06:31,217 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 00:06:31,217 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 00:06:31,217 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35499,1689984379745' in zk 2023-07-22 00:06:31,218 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,218 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:06:31,218 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:06:31,218 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. 2023-07-22 00:06:31,219 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. started... 2023-07-22 00:06:31,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,222 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 00:06:31,222 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,222 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 00:06:31,222 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:06:31,222 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:31,222 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 00:06:31,222 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:06:31,222 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:06:31,222 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. 2023-07-22 00:06:31,224 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. started... 2023-07-22 00:06:31,227 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87b455af543ad9b924432665f2eee14b: 2023-07-22 00:06:31,227 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 58c97dc894529e6ced4482f479199172: 2023-07-22 00:06:31,228 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,228 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,236 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:06:31,236 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:06:31,240 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:06:31,240 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:06:31,249 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:31,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 00:06:31,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:06:31,259 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:06:31,269 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. completed. 2023-07-22 00:06:31,270 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. 2023-07-22 00:06:31,270 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:06:31,270 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:06:31,270 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,270 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 00:06:31,270 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40519,1689984379684' in zk 2023-07-22 00:06:31,273 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,273 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 00:06:31,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,273 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:31,273 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 00:06:31,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,276 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. completed. 2023-07-22 00:06:31,276 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. 2023-07-22 00:06:31,276 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:06:31,276 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:06:31,276 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,276 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-22 00:06:31,276 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43309,1689984379801' in zk 2023-07-22 00:06:31,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,278 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 00:06:31,278 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,278 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:31,279 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-22 00:06:31,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40519,1689984379684': 2023-07-22 00:06:31,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-22 00:06:31,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43309,1689984379801': 2023-07-22 00:06:31,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-22 00:06:31,289 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-22 00:06:31,289 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:06:31,290 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:06:31,290 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,290 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:06:31,293 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,293 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,293 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,293 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,293 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,293 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,294 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,295 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,296 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,299 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,302 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,302 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,303 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,324 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,324 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,324 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,324 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,324 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,324 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,325 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName because node does not exist (not an error) 2023-07-22 00:06:31,324 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,325 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,325 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:31,325 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,325 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,326 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,326 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,326 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,326 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,326 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,326 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,327 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,327 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,327 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,442 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-22 00:06:31,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,442 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:31,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689984391135Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689984391325 (+190 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689984391326 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689984391345 (+19 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689984391377 (+32 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689984391442 (+65 ms) 2023-07-22 00:06:31,444 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 00:06:31,447 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 303 msec 2023-07-22 00:06:31,459 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:31,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 00:06:31,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:06:31,479 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:31,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40519] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:06:31,484 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:31,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43309] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:06:31,490 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-22 00:06:31,491 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. 2023-07-22 00:06:31,492 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:06:31,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 00:06:31,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984391520 (current time:1689984391520). 2023-07-22 00:06:31,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:06:31,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x3698fb70 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:31,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48ee3205, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:31,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:31,529 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:31,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3698fb70 to 127.0.0.1:58666 2023-07-22 00:06:31,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:06:31,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x433b49b2 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:31,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@328969de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:31,538 DEBUG [hconnection-0xbce0b90-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:31,540 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:31,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x433b49b2 to 127.0.0.1:58666 2023-07-22 00:06:31,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:06:31,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-22 00:06:31,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:06:31,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 00:06:31,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 00:06:31,551 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 00:06:31,552 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689984991552 2023-07-22 00:06:31,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-22 00:06:31,552 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-22 00:06:31,553 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:06:31,554 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:06:31,555 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-22 00:06:31,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 00:06:31,556 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-22 00:06:31,557 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 00:06:31,558 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689984991558 2023-07-22 00:06:31,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-22 00:06:31,577 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-22 00:06:31,577 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:31,578 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-22 00:06:31,578 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-22 00:06:31,578 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,578 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,580 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,580 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,580 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,580 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,580 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,580 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,581 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,581 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:06:31,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 00:06:31,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 00:06:31,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-22 00:06:31,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,582 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 00:06:31,582 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 00:06:31,582 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-22 00:06:31,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 00:06:31,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 00:06:31,582 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 00:06:31,582 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 00:06:31,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-22 00:06:31,582 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:31,582 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-22 00:06:31,583 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 00:06:31,583 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 00:06:31,583 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 00:06:31,582 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:31,583 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:31,584 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 00:06:31,585 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-22 00:06:31,585 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 00:06:31,585 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-22 00:06:31,585 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 00:06:31,585 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-22 00:06:31,587 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,587 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,588 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,588 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,590 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,590 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,590 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:31,590 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,591 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:31,591 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,591 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:31,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:31,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-22 00:06:31,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d3c2432[Count = 1] remaining members to acquire global barrier 2023-07-22 00:06:31,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:31,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-22 00:06:31,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d3c2432[Count = 0] remaining members to acquire global barrier 2023-07-22 00:06:31,595 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-22 00:06:31,595 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,599 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,599 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,599 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,600 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 00:06:31,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,600 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,600 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:06:31,600 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. 2023-07-22 00:06:31,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,600 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:06:31,600 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 00:06:31,600 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,600 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:06:31,600 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-22 00:06:31,600 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. started... 2023-07-22 00:06:31,600 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 00:06:31,600 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35499,1689984379745' in zk 2023-07-22 00:06:31,600 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:06:31,600 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:06:31,600 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. 2023-07-22 00:06:31,600 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. started... 2023-07-22 00:06:31,600 INFO [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 58c97dc894529e6ced4482f479199172 1/1 column families, dataSize=2.74 KB heapSize=6.16 KB 2023-07-22 00:06:31,601 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 87b455af543ad9b924432665f2eee14b 1/1 column families, dataSize=534 B heapSize=1.38 KB 2023-07-22 00:06:31,603 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 00:06:31,603 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:31,603 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 00:06:31,654 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:31,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 00:06:31,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:06:31,656 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:06:31,728 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=534 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b/.tmp/cf/25d8808c5a3141039cf103bb0f0eff57 2023-07-22 00:06:31,733 INFO [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.74 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172/.tmp/cf/960aeaa15e8445d2bfa1cd78e1cfe291 2023-07-22 00:06:31,800 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b/.tmp/cf/25d8808c5a3141039cf103bb0f0eff57 as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b/cf/25d8808c5a3141039cf103bb0f0eff57 2023-07-22 00:06:31,800 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172/.tmp/cf/960aeaa15e8445d2bfa1cd78e1cfe291 as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172/cf/960aeaa15e8445d2bfa1cd78e1cfe291 2023-07-22 00:06:31,810 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b/cf/25d8808c5a3141039cf103bb0f0eff57, entries=8, sequenceid=6, filesize=5.4 K 2023-07-22 00:06:31,810 INFO [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172/cf/960aeaa15e8445d2bfa1cd78e1cfe291, entries=42, sequenceid=6, filesize=7.7 K 2023-07-22 00:06:31,816 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~534 B/534, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 87b455af543ad9b924432665f2eee14b in 215ms, sequenceid=6, compaction requested=false 2023-07-22 00:06:31,817 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-22 00:06:31,817 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87b455af543ad9b924432665f2eee14b: 2023-07-22 00:06:31,818 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-22 00:06:31,818 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:06:31,818 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b/cf/25d8808c5a3141039cf103bb0f0eff57] hfiles 2023-07-22 00:06:31,818 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b/cf/25d8808c5a3141039cf103bb0f0eff57 for snapshot=snaptb0-testExportWithTargetName 2023-07-22 00:06:31,819 INFO [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.74 KB/2802, heapSize ~6.14 KB/6288, currentSize=0 B/0 for 58c97dc894529e6ced4482f479199172 in 218ms, sequenceid=6, compaction requested=false 2023-07-22 00:06:31,822 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 58c97dc894529e6ced4482f479199172: 2023-07-22 00:06:31,823 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-22 00:06:31,823 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:06:31,823 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172/cf/960aeaa15e8445d2bfa1cd78e1cfe291] hfiles 2023-07-22 00:06:31,823 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172/cf/960aeaa15e8445d2bfa1cd78e1cfe291 for snapshot=snaptb0-testExportWithTargetName 2023-07-22 00:06:31,857 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:31,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 00:06:31,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:06:31,859 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 00:06:31,860 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. completed. 2023-07-22 00:06:31,860 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. 2023-07-22 00:06:31,860 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:06:31,860 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:06:31,860 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,860 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 00:06:31,860 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40519,1689984379684' in zk 2023-07-22 00:06:31,862 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 00:06:31,862 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,863 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:31,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,863 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 00:06:31,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:31,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,867 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. completed. 2023-07-22 00:06:31,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,867 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. 2023-07-22 00:06:31,868 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:06:31,868 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:06:31,868 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,868 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-22 00:06:31,868 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43309,1689984379801' in zk 2023-07-22 00:06:31,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,870 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-22 00:06:31,870 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,870 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:31,870 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-22 00:06:31,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:31,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40519,1689984379684': 2023-07-22 00:06:31,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-22 00:06:31,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:31,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:31,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43309,1689984379801': 2023-07-22 00:06:31,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-22 00:06:31,879 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-22 00:06:31,879 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:06:31,879 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:06:31,879 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-22 00:06:31,879 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:06:31,882 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,882 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,882 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,882 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,882 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,882 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:31,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:31,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,882 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:31,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,885 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:31,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,886 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:31,886 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:31,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:31,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-22 00:06:31,889 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,889 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,895 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,908 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,908 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,908 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,908 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,908 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-22 00:06:31,908 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:31,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-22 00:06:31,909 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,908 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:31,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,908 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,908 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:31,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,908 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:31,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,909 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,911 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:31,911 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:31,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,911 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:31,912 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:31,912 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,912 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:31,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:31,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,997 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-22 00:06:31,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,997 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-22 00:06:31,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689984391552Consolidate snapshot: snaptb0-testExportWithTargetName at 1689984391908 (+356 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689984391909 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689984391917 (+8 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689984391935 (+18 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689984391997 (+62 ms) 2023-07-22 00:06:31,999 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-22 00:06:32,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 446 msec 2023-07-22 00:06:32,159 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:32,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-22 00:06:32,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:06:32,164 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984392164 2023-07-22 00:06:32,165 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34573, tgtDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984392164, rawTgtDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984392164, srcFsUri=hdfs://localhost:34573, srcDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:06:32,211 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34573, inputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:06:32,211 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_666387223_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984392164, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984392164/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-22 00:06:32,211 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34573, inputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d, snapshotDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-22 00:06:32,235 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984392164/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-22 00:06:32,321 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,322 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,322 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,323 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,324 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,324 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,325 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,428 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/hadoop-5665502532515409570.jar 2023-07-22 00:06:32,429 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,430 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,430 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,431 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,435 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,436 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:32,436 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 00:06:32,438 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 00:06:32,440 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 00:06:32,441 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 00:06:32,442 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 00:06:32,443 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 00:06:32,444 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 00:06:32,444 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 00:06:32,445 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 00:06:32,446 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 00:06:32,450 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:06:32,451 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:06:32,451 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:06:32,452 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:06:32,452 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:06:32,453 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:06:32,453 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:06:34,026 WARN [Listener at jenkins-hbase4.apache.org/40445] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 00:06:34,034 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-22 00:06:34,044 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-22 00:06:34,634 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:06:34,636 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:06:34,934 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0001_000001 (auth:SIMPLE) 2023-07-22 00:06:35,944 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 00:06:40,512 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0001_000001 (auth:SIMPLE) 2023-07-22 00:06:42,794 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0001_000001 (auth:SIMPLE) 2023-07-22 00:06:45,913 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0001_000001 (auth:SIMPLE) 2023-07-22 00:06:47,075 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 00:06:47,079 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 00:06:47,088 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-22 00:06:47,088 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 00:06:47,089 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 00:06:47,089 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1699920953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-22 00:06:47,090 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-22 00:06:47,090 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-22 00:06:47,090 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1699920953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984392164/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984392164/.hbase-snapshot/testExportWithTargetName 2023-07-22 00:06:47,091 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984392164/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-22 00:06:47,091 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984392164/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-22 00:06:47,101 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-22 00:06:47,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-22 00:06:47,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-22 00:06:47,119 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984407118"}]},"ts":"1689984407118"} 2023-07-22 00:06:47,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 00:06:47,121 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-22 00:06:47,123 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-22 00:06:47,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=87b455af543ad9b924432665f2eee14b, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=58c97dc894529e6ced4482f479199172, UNASSIGN}] 2023-07-22 00:06:47,127 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=87b455af543ad9b924432665f2eee14b, UNASSIGN 2023-07-22 00:06:47,127 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=58c97dc894529e6ced4482f479199172, UNASSIGN 2023-07-22 00:06:47,128 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=87b455af543ad9b924432665f2eee14b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:47,129 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=58c97dc894529e6ced4482f479199172, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:47,129 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984407128"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984407128"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984407128"}]},"ts":"1689984407128"} 2023-07-22 00:06:47,129 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984407129"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984407129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984407129"}]},"ts":"1689984407129"} 2023-07-22 00:06:47,131 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 87b455af543ad9b924432665f2eee14b, server=jenkins-hbase4.apache.org,40519,1689984379684}] 2023-07-22 00:06:47,132 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 58c97dc894529e6ced4482f479199172, server=jenkins-hbase4.apache.org,43309,1689984379801}] 2023-07-22 00:06:47,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 00:06:47,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 87b455af543ad9b924432665f2eee14b 2023-07-22 00:06:47,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 58c97dc894529e6ced4482f479199172 2023-07-22 00:06:47,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 87b455af543ad9b924432665f2eee14b, disabling compactions & flushes 2023-07-22 00:06:47,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 58c97dc894529e6ced4482f479199172, disabling compactions & flushes 2023-07-22 00:06:47,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. 2023-07-22 00:06:47,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. 2023-07-22 00:06:47,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. 2023-07-22 00:06:47,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. 2023-07-22 00:06:47,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. after waiting 0 ms 2023-07-22 00:06:47,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. after waiting 0 ms 2023-07-22 00:06:47,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. 2023-07-22 00:06:47,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. 2023-07-22 00:06:47,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:06:47,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:06:47,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:06:47,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:06:47,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172. 2023-07-22 00:06:47,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b. 2023-07-22 00:06:47,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 58c97dc894529e6ced4482f479199172: 2023-07-22 00:06:47,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 87b455af543ad9b924432665f2eee14b: 2023-07-22 00:06:47,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 87b455af543ad9b924432665f2eee14b 2023-07-22 00:06:47,314 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=87b455af543ad9b924432665f2eee14b, regionState=CLOSED 2023-07-22 00:06:47,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 58c97dc894529e6ced4482f479199172 2023-07-22 00:06:47,315 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984407314"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984407314"}]},"ts":"1689984407314"} 2023-07-22 00:06:47,315 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=58c97dc894529e6ced4482f479199172, regionState=CLOSED 2023-07-22 00:06:47,316 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689984407315"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984407315"}]},"ts":"1689984407315"} 2023-07-22 00:06:47,319 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-22 00:06:47,320 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 87b455af543ad9b924432665f2eee14b, server=jenkins-hbase4.apache.org,40519,1689984379684 in 186 msec 2023-07-22 00:06:47,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-22 00:06:47,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 58c97dc894529e6ced4482f479199172, server=jenkins-hbase4.apache.org,43309,1689984379801 in 186 msec 2023-07-22 00:06:47,321 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=87b455af543ad9b924432665f2eee14b, UNASSIGN in 195 msec 2023-07-22 00:06:47,323 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-22 00:06:47,323 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=58c97dc894529e6ced4482f479199172, UNASSIGN in 195 msec 2023-07-22 00:06:47,324 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984407324"}]},"ts":"1689984407324"} 2023-07-22 00:06:47,326 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-22 00:06:47,327 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-22 00:06:47,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 221 msec 2023-07-22 00:06:47,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-22 00:06:47,423 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-22 00:06:47,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-22 00:06:47,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 00:06:47,440 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 00:06:47,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-22 00:06:47,442 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 00:06:47,446 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40519] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-22 00:06:47,448 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b 2023-07-22 00:06:47,448 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172 2023-07-22 00:06:47,449 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 00:06:47,449 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 00:06:47,449 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 00:06:47,449 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 00:06:47,453 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172/cf, FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172/recovered.edits] 2023-07-22 00:06:47,453 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b/cf, FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b/recovered.edits] 2023-07-22 00:06:47,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-22 00:06:47,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-22 00:06:47,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-22 00:06:47,456 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 00:06:47,456 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:47,456 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 00:06:47,456 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:47,456 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-22 00:06:47,456 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:47,456 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:47,456 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-22 00:06:47,456 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 00:06:47,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-22 00:06:47,462 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b/cf/25d8808c5a3141039cf103bb0f0eff57 to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b/cf/25d8808c5a3141039cf103bb0f0eff57 2023-07-22 00:06:47,462 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172/cf/960aeaa15e8445d2bfa1cd78e1cfe291 to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172/cf/960aeaa15e8445d2bfa1cd78e1cfe291 2023-07-22 00:06:47,468 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b/recovered.edits/9.seqid to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b/recovered.edits/9.seqid 2023-07-22 00:06:47,468 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172/recovered.edits/9.seqid to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172/recovered.edits/9.seqid 2023-07-22 00:06:47,469 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/87b455af543ad9b924432665f2eee14b 2023-07-22 00:06:47,469 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportWithTargetName/58c97dc894529e6ced4482f479199172 2023-07-22 00:06:47,469 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-22 00:06:47,472 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 00:06:47,493 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-22 00:06:47,496 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-22 00:06:47,497 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 00:06:47,497 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-22 00:06:47,497 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984407497"}]},"ts":"9223372036854775807"} 2023-07-22 00:06:47,498 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984407497"}]},"ts":"9223372036854775807"} 2023-07-22 00:06:47,500 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 00:06:47,500 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 87b455af543ad9b924432665f2eee14b, NAME => 'testtb-testExportWithTargetName,,1689984389880.87b455af543ad9b924432665f2eee14b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 58c97dc894529e6ced4482f479199172, NAME => 'testtb-testExportWithTargetName,1,1689984389880.58c97dc894529e6ced4482f479199172.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 00:06:47,500 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-22 00:06:47,500 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689984407500"}]},"ts":"9223372036854775807"} 2023-07-22 00:06:47,502 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-22 00:06:47,504 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-22 00:06:47,506 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 73 msec 2023-07-22 00:06:47,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-22 00:06:47,561 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-22 00:06:47,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-22 00:06:47,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-22 00:06:47,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-22 00:06:47,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-22 00:06:47,623 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=753 (was 709) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: (jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1699920953_17 at /127.0.0.1:50344 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/cluster_0032ba5a-a217-3173-3cbc-083e8f7fc05b/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/cluster_0032ba5a-a217-3173-3cbc-083e8f7fc05b/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1699920953_17 at /127.0.0.1:46070 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/cluster_0032ba5a-a217-3173-3cbc-083e8f7fc05b/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_383271877_1 at /127.0.0.1:50316 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:34177 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/cluster_0032ba5a-a217-3173-3cbc-083e8f7fc05b/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1699920953_17 at /127.0.0.1:58214 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/cluster_0032ba5a-a217-3173-3cbc-083e8f7fc05b/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:40841 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/cluster_0032ba5a-a217-3173-3cbc-083e8f7fc05b/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 909) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=335 (was 271) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=7689 (was 9339) 2023-07-22 00:06:47,623 WARN [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-22 00:06:47,656 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=335, ProcessCount=178, AvailableMemoryMB=7688 2023-07-22 00:06:47,656 WARN [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-22 00:06:47,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 00:06:47,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-22 00:06:47,663 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:06:47,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-22 00:06:47,664 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:06:47,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 00:06:47,667 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70 2023-07-22 00:06:47,668 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480 2023-07-22 00:06:47,668 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70 empty. 2023-07-22 00:06:47,668 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480 empty. 2023-07-22 00:06:47,669 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480 2023-07-22 00:06:47,669 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70 2023-07-22 00:06:47,669 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-22 00:06:47,684 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-22 00:06:47,686 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2d57d9576d990d45a48f1722273caf70, NAME => 'testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp 2023-07-22 00:06:47,686 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 610be6a22f5970e11999bf11c835a480, NAME => 'testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp 2023-07-22 00:06:47,711 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:47,712 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:47,716 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 2d57d9576d990d45a48f1722273caf70, disabling compactions & flushes 2023-07-22 00:06:47,716 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 610be6a22f5970e11999bf11c835a480, disabling compactions & flushes 2023-07-22 00:06:47,716 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. 2023-07-22 00:06:47,716 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. 2023-07-22 00:06:47,716 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. 2023-07-22 00:06:47,716 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. 2023-07-22 00:06:47,716 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. after waiting 0 ms 2023-07-22 00:06:47,716 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. after waiting 0 ms 2023-07-22 00:06:47,716 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. 2023-07-22 00:06:47,716 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. 2023-07-22 00:06:47,716 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. 2023-07-22 00:06:47,716 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. 2023-07-22 00:06:47,716 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 610be6a22f5970e11999bf11c835a480: 2023-07-22 00:06:47,716 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 2d57d9576d990d45a48f1722273caf70: 2023-07-22 00:06:47,719 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:06:47,720 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984407720"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984407720"}]},"ts":"1689984407720"} 2023-07-22 00:06:47,721 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984407720"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984407720"}]},"ts":"1689984407720"} 2023-07-22 00:06:47,724 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 00:06:47,725 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:06:47,725 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984407725"}]},"ts":"1689984407725"} 2023-07-22 00:06:47,726 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-22 00:06:47,729 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:06:47,731 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:06:47,731 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:06:47,731 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:06:47,731 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:06:47,731 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2d57d9576d990d45a48f1722273caf70, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=610be6a22f5970e11999bf11c835a480, ASSIGN}] 2023-07-22 00:06:47,734 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2d57d9576d990d45a48f1722273caf70, ASSIGN 2023-07-22 00:06:47,734 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=610be6a22f5970e11999bf11c835a480, ASSIGN 2023-07-22 00:06:47,735 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2d57d9576d990d45a48f1722273caf70, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35499,1689984379745; forceNewPlan=false, retain=false 2023-07-22 00:06:47,735 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=610be6a22f5970e11999bf11c835a480, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43309,1689984379801; forceNewPlan=false, retain=false 2023-07-22 00:06:47,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 00:06:47,886 INFO [jenkins-hbase4:42695] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 00:06:47,890 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=610be6a22f5970e11999bf11c835a480, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:47,890 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=2d57d9576d990d45a48f1722273caf70, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:47,891 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984407890"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984407890"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984407890"}]},"ts":"1689984407890"} 2023-07-22 00:06:47,891 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984407890"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984407890"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984407890"}]},"ts":"1689984407890"} 2023-07-22 00:06:47,893 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 610be6a22f5970e11999bf11c835a480, server=jenkins-hbase4.apache.org,43309,1689984379801}] 2023-07-22 00:06:47,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 2d57d9576d990d45a48f1722273caf70, server=jenkins-hbase4.apache.org,35499,1689984379745}] 2023-07-22 00:06:47,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 00:06:48,051 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,051 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 00:06:48,056 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 00:06:48,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. 2023-07-22 00:06:48,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 610be6a22f5970e11999bf11c835a480, NAME => 'testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 00:06:48,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. service=AccessControlService 2023-07-22 00:06:48,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:48,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 610be6a22f5970e11999bf11c835a480 2023-07-22 00:06:48,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:48,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 610be6a22f5970e11999bf11c835a480 2023-07-22 00:06:48,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 610be6a22f5970e11999bf11c835a480 2023-07-22 00:06:48,068 INFO [StoreOpener-610be6a22f5970e11999bf11c835a480-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 610be6a22f5970e11999bf11c835a480 2023-07-22 00:06:48,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. 2023-07-22 00:06:48,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2d57d9576d990d45a48f1722273caf70, NAME => 'testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 00:06:48,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. service=AccessControlService 2023-07-22 00:06:48,069 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:06:48,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 2d57d9576d990d45a48f1722273caf70 2023-07-22 00:06:48,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:06:48,070 DEBUG [StoreOpener-610be6a22f5970e11999bf11c835a480-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480/cf 2023-07-22 00:06:48,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2d57d9576d990d45a48f1722273caf70 2023-07-22 00:06:48,070 DEBUG [StoreOpener-610be6a22f5970e11999bf11c835a480-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480/cf 2023-07-22 00:06:48,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2d57d9576d990d45a48f1722273caf70 2023-07-22 00:06:48,070 INFO [StoreOpener-610be6a22f5970e11999bf11c835a480-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 610be6a22f5970e11999bf11c835a480 columnFamilyName cf 2023-07-22 00:06:48,071 INFO [StoreOpener-610be6a22f5970e11999bf11c835a480-1] regionserver.HStore(310): Store=610be6a22f5970e11999bf11c835a480/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:48,072 INFO [StoreOpener-2d57d9576d990d45a48f1722273caf70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2d57d9576d990d45a48f1722273caf70 2023-07-22 00:06:48,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480 2023-07-22 00:06:48,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480 2023-07-22 00:06:48,075 DEBUG [StoreOpener-2d57d9576d990d45a48f1722273caf70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70/cf 2023-07-22 00:06:48,075 DEBUG [StoreOpener-2d57d9576d990d45a48f1722273caf70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70/cf 2023-07-22 00:06:48,076 INFO [StoreOpener-2d57d9576d990d45a48f1722273caf70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d57d9576d990d45a48f1722273caf70 columnFamilyName cf 2023-07-22 00:06:48,077 INFO [StoreOpener-2d57d9576d990d45a48f1722273caf70-1] regionserver.HStore(310): Store=2d57d9576d990d45a48f1722273caf70/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:06:48,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 610be6a22f5970e11999bf11c835a480 2023-07-22 00:06:48,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70 2023-07-22 00:06:48,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70 2023-07-22 00:06:48,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2d57d9576d990d45a48f1722273caf70 2023-07-22 00:06:48,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:06:48,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2d57d9576d990d45a48f1722273caf70; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68859332, jitterRate=0.02608400583267212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:06:48,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2d57d9576d990d45a48f1722273caf70: 2023-07-22 00:06:48,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:06:48,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70., pid=31, masterSystemTime=1689984408050 2023-07-22 00:06:48,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 610be6a22f5970e11999bf11c835a480; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66257915, jitterRate=-0.01268012821674347}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:06:48,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 610be6a22f5970e11999bf11c835a480: 2023-07-22 00:06:48,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480., pid=30, masterSystemTime=1689984408047 2023-07-22 00:06:48,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. 2023-07-22 00:06:48,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. 2023-07-22 00:06:48,103 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=2d57d9576d990d45a48f1722273caf70, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,104 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984408103"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984408103"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984408103"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984408103"}]},"ts":"1689984408103"} 2023-07-22 00:06:48,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. 2023-07-22 00:06:48,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. 2023-07-22 00:06:48,105 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=610be6a22f5970e11999bf11c835a480, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,106 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984408105"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984408105"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984408105"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984408105"}]},"ts":"1689984408105"} 2023-07-22 00:06:48,111 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-22 00:06:48,111 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 2d57d9576d990d45a48f1722273caf70, server=jenkins-hbase4.apache.org,35499,1689984379745 in 213 msec 2023-07-22 00:06:48,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-22 00:06:48,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 610be6a22f5970e11999bf11c835a480, server=jenkins-hbase4.apache.org,43309,1689984379801 in 216 msec 2023-07-22 00:06:48,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2d57d9576d990d45a48f1722273caf70, ASSIGN in 380 msec 2023-07-22 00:06:48,117 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-22 00:06:48,117 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=610be6a22f5970e11999bf11c835a480, ASSIGN in 383 msec 2023-07-22 00:06:48,118 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:06:48,118 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984408118"}]},"ts":"1689984408118"} 2023-07-22 00:06:48,120 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-22 00:06:48,123 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:06:48,123 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-22 00:06:48,126 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40519] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 00:06:48,127 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:48,127 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:48,127 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:48,127 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:06:48,129 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 00:06:48,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 469 msec 2023-07-22 00:06:48,133 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 00:06:48,133 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 00:06:48,133 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 00:06:48,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-22 00:06:48,275 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-22 00:06:48,275 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-22 00:06:48,275 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:06:48,283 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-22 00:06:48,284 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:06:48,284 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-22 00:06:48,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:06:48,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984408299 (current time:1689984408299). 2023-07-22 00:06:48,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:06:48,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x788d81d1 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:48,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1006b968, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:48,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:48,336 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:48,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x788d81d1 to 127.0.0.1:58666 2023-07-22 00:06:48,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:06:48,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x0806f350 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:48,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c116888, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:48,363 DEBUG [hconnection-0x39795f9b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:48,364 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:48,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0806f350 to 127.0.0.1:58666 2023-07-22 00:06:48,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:06:48,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 00:06:48,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:06:48,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:06:48,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:06:48,378 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:06:48,379 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689985008379 2023-07-22 00:06:48,380 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-22 00:06:48,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:06:48,383 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:06:48,383 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:06:48,385 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:06:48,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 00:06:48,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-22 00:06:48,388 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 00:06:48,389 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689985008389 2023-07-22 00:06:48,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,450 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-22 00:06:48,450 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:48,452 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-22 00:06:48,452 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-22 00:06:48,452 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,452 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,455 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,455 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,456 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,456 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 00:06:48,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,457 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 00:06:48,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,457 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,458 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 00:06:48,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,458 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 00:06:48,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-22 00:06:48,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,459 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 00:06:48,460 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,460 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:06:48,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,463 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 00:06:48,463 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:48,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,463 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 00:06:48,463 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:48,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,463 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 00:06:48,465 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 00:06:48,465 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 00:06:48,465 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 00:06:48,465 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 00:06:48,465 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 00:06:48,465 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 00:06:48,465 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:48,471 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 00:06:48,471 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-22 00:06:48,471 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-22 00:06:48,473 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,477 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,477 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,477 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:48,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:48,477 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:48,479 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,479 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:48,479 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,479 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:48,479 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,479 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:48,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:48,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:48,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-22 00:06:48,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e9e697b[Count = 1] remaining members to acquire global barrier 2023-07-22 00:06:48,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:48,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:48,483 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:48,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:48,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:48,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:06:48,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:06:48,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,485 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:06:48,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:48,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-22 00:06:48,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e9e697b[Count = 0] remaining members to acquire global barrier 2023-07-22 00:06:48,486 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 00:06:48,486 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,487 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,487 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,487 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,487 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,487 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:06:48,487 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:06:48,487 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 00:06:48,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,488 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40519,1689984379684' in zk 2023-07-22 00:06:48,488 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:06:48,488 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:06:48,488 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. 2023-07-22 00:06:48,488 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:06:48,488 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. started... 2023-07-22 00:06:48,488 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,488 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:06:48,488 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:06:48,488 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:06:48,490 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. 2023-07-22 00:06:48,490 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 610be6a22f5970e11999bf11c835a480: 2023-07-22 00:06:48,490 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. started... 2023-07-22 00:06:48,491 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2d57d9576d990d45a48f1722273caf70: 2023-07-22 00:06:48,491 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,491 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 00:06:48,491 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:06:48,491 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,491 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:48,492 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:06:48,492 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 00:06:48,491 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:06:48,493 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:06:48,522 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. completed. 2023-07-22 00:06:48,522 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. 2023-07-22 00:06:48,523 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:06:48,523 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:06:48,523 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,523 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 00:06:48,523 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43309,1689984379801' in zk 2023-07-22 00:06:48,525 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,525 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 00:06:48,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,526 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:48,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:48,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:48,526 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 00:06:48,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:48,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:48,529 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. completed. 2023-07-22 00:06:48,529 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. 2023-07-22 00:06:48,529 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:06:48,529 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:06:48,530 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,530 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-22 00:06:48,530 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35499,1689984379745' in zk 2023-07-22 00:06:48,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,533 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 00:06:48,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,533 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:48,533 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,533 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-22 00:06:48,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:48,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43309,1689984379801': 2023-07-22 00:06:48,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 00:06:48,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:48,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:48,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:48,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:48,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:48,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35499,1689984379745': 2023-07-22 00:06:48,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 00:06:48,545 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-22 00:06:48,545 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:06:48,545 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:06:48,545 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,545 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:06:48,547 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,547 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,547 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,547 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,547 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,547 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,547 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:48,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:48,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,548 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,549 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:48,550 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:48,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,552 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,553 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,553 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,556 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,556 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,557 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,556 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,557 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,557 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,557 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,557 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:48,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,557 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,557 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,557 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,559 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,559 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,559 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,559 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,559 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,559 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,559 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,560 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,613 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-22 00:06:48,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,613 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-22 00:06:48,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689984408380Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689984408557 (+177 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689984408559 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689984408564 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689984408580 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689984408613 (+33 ms) 2023-07-22 00:06:48,616 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 00:06:48,618 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 235 msec 2023-07-22 00:06:48,685 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:48,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:06:48,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:06:48,696 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:48,702 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41436, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:48,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35499] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:06:48,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43309] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:06:48,707 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-22 00:06:48,707 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. 2023-07-22 00:06:48,708 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:06:48,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:06:48,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984408721 (current time:1689984408721). 2023-07-22 00:06:48,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:06:48,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x3c124e9b to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:48,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@755eec35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:48,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:48,732 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:48,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c124e9b to 127.0.0.1:58666 2023-07-22 00:06:48,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:06:48,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x71adc0ed to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:06:48,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d584e58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:06:48,743 DEBUG [hconnection-0x393f97b8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:06:48,745 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:06:48,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71adc0ed to 127.0.0.1:58666 2023-07-22 00:06:48,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:06:48,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 00:06:48,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:06:48,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:06:48,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:06:48,755 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:06:48,756 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689985008756 2023-07-22 00:06:48,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:06:48,756 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-22 00:06:48,757 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:06:48,757 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:06:48,758 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:06:48,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 00:06:48,760 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-22 00:06:48,761 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 00:06:48,761 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689985008761 2023-07-22 00:06:48,773 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-22 00:06:48,773 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-22 00:06:48,773 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:48,775 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-22 00:06:48,775 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-22 00:06:48,775 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,775 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,776 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,777 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,777 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,777 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,777 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,777 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,778 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,778 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:06:48,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 00:06:48,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 00:06:48,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-22 00:06:48,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,778 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 00:06:48,778 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 00:06:48,779 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-22 00:06:48,779 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 00:06:48,779 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 00:06:48,779 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 00:06:48,779 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:48,779 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 00:06:48,779 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:48,782 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 00:06:48,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-22 00:06:48,782 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 00:06:48,782 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 00:06:48,782 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 00:06:48,782 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-22 00:06:48,782 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:06:48,782 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 00:06:48,783 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-22 00:06:48,783 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-22 00:06:48,783 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 00:06:48,782 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-22 00:06:48,786 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,786 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,787 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:48,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:48,787 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,787 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,787 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,787 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,787 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:48,787 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:48,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:48,788 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,788 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:06:48,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:48,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:48,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-22 00:06:48,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@527fc52e[Count = 1] remaining members to acquire global barrier 2023-07-22 00:06:48,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:48,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:48,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:48,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:48,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:48,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-22 00:06:48,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@527fc52e[Count = 0] remaining members to acquire global barrier 2023-07-22 00:06:48,792 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 00:06:48,792 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,793 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,793 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,793 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,793 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:06:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,793 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,793 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:06:48,793 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:06:48,793 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 00:06:48,793 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40519,1689984379684' in zk 2023-07-22 00:06:48,793 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:06:48,793 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:06:48,794 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. 2023-07-22 00:06:48,794 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:06:48,794 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. started... 2023-07-22 00:06:48,794 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,794 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:06:48,794 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:06:48,794 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. 2023-07-22 00:06:48,794 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. started... 2023-07-22 00:06:48,794 INFO [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 610be6a22f5970e11999bf11c835a480 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-22 00:06:48,794 INFO [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2d57d9576d990d45a48f1722273caf70 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-22 00:06:48,795 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 00:06:48,795 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:48,795 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 00:06:48,813 INFO [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70/.tmp/cf/e9dc74cd083d41d9a3c80e1899c7c70f 2023-07-22 00:06:48,815 INFO [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480/.tmp/cf/23eda588a3ea4d40aa4d0dd0dde5a628 2023-07-22 00:06:48,824 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70/.tmp/cf/e9dc74cd083d41d9a3c80e1899c7c70f as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70/cf/e9dc74cd083d41d9a3c80e1899c7c70f 2023-07-22 00:06:48,826 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480/.tmp/cf/23eda588a3ea4d40aa4d0dd0dde5a628 as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480/cf/23eda588a3ea4d40aa4d0dd0dde5a628 2023-07-22 00:06:48,831 INFO [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70/cf/e9dc74cd083d41d9a3c80e1899c7c70f, entries=5, sequenceid=6, filesize=5.2 K 2023-07-22 00:06:48,833 INFO [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 2d57d9576d990d45a48f1722273caf70 in 39ms, sequenceid=6, compaction requested=false 2023-07-22 00:06:48,833 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-22 00:06:48,834 INFO [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480/cf/23eda588a3ea4d40aa4d0dd0dde5a628, entries=45, sequenceid=6, filesize=7.9 K 2023-07-22 00:06:48,835 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2d57d9576d990d45a48f1722273caf70: 2023-07-22 00:06:48,835 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-22 00:06:48,835 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:06:48,835 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70/cf/e9dc74cd083d41d9a3c80e1899c7c70f] hfiles 2023-07-22 00:06:48,835 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70/cf/e9dc74cd083d41d9a3c80e1899c7c70f for snapshot=snaptb0-testExportFileSystemState 2023-07-22 00:06:48,836 INFO [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 610be6a22f5970e11999bf11c835a480 in 42ms, sequenceid=6, compaction requested=false 2023-07-22 00:06:48,837 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 610be6a22f5970e11999bf11c835a480: 2023-07-22 00:06:48,837 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-22 00:06:48,837 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:06:48,837 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480/cf/23eda588a3ea4d40aa4d0dd0dde5a628] hfiles 2023-07-22 00:06:48,837 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480/cf/23eda588a3ea4d40aa4d0dd0dde5a628 for snapshot=snaptb0-testExportFileSystemState 2023-07-22 00:06:48,855 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. completed. 2023-07-22 00:06:48,855 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. 2023-07-22 00:06:48,855 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:06:48,855 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:06:48,855 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,856 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 00:06:48,856 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35499,1689984379745' in zk 2023-07-22 00:06:48,857 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:48,858 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. completed. 2023-07-22 00:06:48,858 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. 2023-07-22 00:06:48,858 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:06:48,858 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:06:48,858 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,859 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-22 00:06:48,859 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43309,1689984379801' in zk 2023-07-22 00:06:48,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:06:48,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:06:48,859 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:06:48,861 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,861 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 00:06:48,861 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:48,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:48,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:48,861 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 00:06:48,867 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-22 00:06:48,868 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:48,868 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-22 00:06:48,870 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:48,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:48,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:48,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35499,1689984379745': 2023-07-22 00:06:48,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 00:06:48,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:48,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:48,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:48,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:48,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:48,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43309,1689984379801': 2023-07-22 00:06:48,880 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 00:06:48,880 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-22 00:06:48,880 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:06:48,880 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:06:48,880 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-22 00:06:48,880 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:06:48,882 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,882 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,882 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,882 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,882 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:06:48,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:06:48,882 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,882 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:06:48,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:06:48,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,885 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,885 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,886 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:06:48,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-22 00:06:48,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,888 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,890 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,890 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,893 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,893 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,893 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,893 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,893 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,893 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,893 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,893 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:06:48,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,893 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,893 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-22 00:06:48,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-22 00:06:48,893 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:06:48,893 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,893 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:06:48,893 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:06:48,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:06:48,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:06:48,895 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,896 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:06:48,896 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:06:48,896 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,896 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:06:48,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:06:48,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,956 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-22 00:06:48,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,956 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 00:06:48,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689984408756Consolidate snapshot: snaptb0-testExportFileSystemState at 1689984408894 (+138 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689984408894Writing data manifest for snaptb0-testExportFileSystemState at 1689984408902 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689984408913 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689984408956 (+43 ms) 2023-07-22 00:06:48,959 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-22 00:06:48,962 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 203 msec 2023-07-22 00:06:49,060 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:06:49,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:06:49,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:06:49,066 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984409066 2023-07-22 00:06:49,066 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34573, tgtDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984409066, rawTgtDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984409066, srcFsUri=hdfs://localhost:34573, srcDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:06:49,094 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34573, inputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:06:49,094 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1488563742_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984409066, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984409066/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 00:06:49,094 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34573, inputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d, snapshotDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-22 00:06:49,107 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984409066/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-22 00:06:49,140 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,140 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,140 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,141 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,141 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,141 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,142 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,216 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/hadoop-3782889208244191955.jar 2023-07-22 00:06:49,216 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,216 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,217 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,217 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,217 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,218 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 00:06:49,218 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 00:06:49,219 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 00:06:49,219 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 00:06:49,220 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 00:06:49,220 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 00:06:49,220 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 00:06:49,221 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 00:06:49,221 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 00:06:49,221 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 00:06:49,222 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 00:06:49,222 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:06:49,223 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:06:49,223 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:06:49,223 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:06:49,224 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:06:49,224 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:06:49,224 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:06:49,709 WARN [Listener at jenkins-hbase4.apache.org/40445] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 00:06:49,712 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-22 00:06:49,714 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-22 00:06:52,124 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:06:52,124 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:06:52,129 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0001_000001 (auth:SIMPLE) 2023-07-22 00:06:52,492 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0002_000001 (auth:SIMPLE) 2023-07-22 00:06:52,896 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 00:06:57,282 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0002_000001 (auth:SIMPLE) 2023-07-22 00:06:59,503 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0002_000001 (auth:SIMPLE) 2023-07-22 00:07:02,500 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0002_000001 (auth:SIMPLE) 2023-07-22 00:07:03,922 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 00:07:03,923 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 00:07:03,930 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-22 00:07:03,930 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 00:07:03,931 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 00:07:03,931 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1699920953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 00:07:03,931 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-22 00:07:03,931 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-22 00:07:03,931 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1699920953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984409066/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984409066/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-22 00:07:03,932 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984409066/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-22 00:07:03,932 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984409066/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-22 00:07:03,939 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-22 00:07:03,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-22 00:07:03,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-22 00:07:03,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 00:07:03,945 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984423945"}]},"ts":"1689984423945"} 2023-07-22 00:07:03,947 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-22 00:07:03,948 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-22 00:07:03,949 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2d57d9576d990d45a48f1722273caf70, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=610be6a22f5970e11999bf11c835a480, UNASSIGN}] 2023-07-22 00:07:03,952 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2d57d9576d990d45a48f1722273caf70, UNASSIGN 2023-07-22 00:07:03,952 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=610be6a22f5970e11999bf11c835a480, UNASSIGN 2023-07-22 00:07:03,953 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=2d57d9576d990d45a48f1722273caf70, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:03,953 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=610be6a22f5970e11999bf11c835a480, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:03,953 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984423953"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984423953"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984423953"}]},"ts":"1689984423953"} 2023-07-22 00:07:03,953 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984423953"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984423953"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984423953"}]},"ts":"1689984423953"} 2023-07-22 00:07:03,955 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 2d57d9576d990d45a48f1722273caf70, server=jenkins-hbase4.apache.org,35499,1689984379745}] 2023-07-22 00:07:03,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 610be6a22f5970e11999bf11c835a480, server=jenkins-hbase4.apache.org,43309,1689984379801}] 2023-07-22 00:07:04,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 00:07:04,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 610be6a22f5970e11999bf11c835a480 2023-07-22 00:07:04,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 610be6a22f5970e11999bf11c835a480, disabling compactions & flushes 2023-07-22 00:07:04,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2d57d9576d990d45a48f1722273caf70 2023-07-22 00:07:04,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. 2023-07-22 00:07:04,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. 2023-07-22 00:07:04,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2d57d9576d990d45a48f1722273caf70, disabling compactions & flushes 2023-07-22 00:07:04,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. after waiting 0 ms 2023-07-22 00:07:04,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. 2023-07-22 00:07:04,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. 2023-07-22 00:07:04,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. 2023-07-22 00:07:04,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. after waiting 0 ms 2023-07-22 00:07:04,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. 2023-07-22 00:07:04,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:07:04,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:07:04,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:07:04,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70. 2023-07-22 00:07:04,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:07:04,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2d57d9576d990d45a48f1722273caf70: 2023-07-22 00:07:04,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480. 2023-07-22 00:07:04,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 610be6a22f5970e11999bf11c835a480: 2023-07-22 00:07:04,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2d57d9576d990d45a48f1722273caf70 2023-07-22 00:07:04,131 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=2d57d9576d990d45a48f1722273caf70, regionState=CLOSED 2023-07-22 00:07:04,132 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 610be6a22f5970e11999bf11c835a480 2023-07-22 00:07:04,132 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984424131"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984424131"}]},"ts":"1689984424131"} 2023-07-22 00:07:04,132 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=610be6a22f5970e11999bf11c835a480, regionState=CLOSED 2023-07-22 00:07:04,132 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689984424132"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984424132"}]},"ts":"1689984424132"} 2023-07-22 00:07:04,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-22 00:07:04,136 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 2d57d9576d990d45a48f1722273caf70, server=jenkins-hbase4.apache.org,35499,1689984379745 in 179 msec 2023-07-22 00:07:04,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-22 00:07:04,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 610be6a22f5970e11999bf11c835a480, server=jenkins-hbase4.apache.org,43309,1689984379801 in 179 msec 2023-07-22 00:07:04,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2d57d9576d990d45a48f1722273caf70, UNASSIGN in 187 msec 2023-07-22 00:07:04,139 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-22 00:07:04,139 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=610be6a22f5970e11999bf11c835a480, UNASSIGN in 188 msec 2023-07-22 00:07:04,139 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984424139"}]},"ts":"1689984424139"} 2023-07-22 00:07:04,141 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-22 00:07:04,142 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-22 00:07:04,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 203 msec 2023-07-22 00:07:04,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-22 00:07:04,248 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-22 00:07:04,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-22 00:07:04,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 00:07:04,252 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 00:07:04,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-22 00:07:04,253 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 00:07:04,255 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40519] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-22 00:07:04,258 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70 2023-07-22 00:07:04,258 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480 2023-07-22 00:07:04,261 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70/cf, FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70/recovered.edits] 2023-07-22 00:07:04,261 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480/cf, FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480/recovered.edits] 2023-07-22 00:07:04,264 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 00:07:04,264 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 00:07:04,264 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 00:07:04,264 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 00:07:04,264 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 00:07:04,264 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 00:07:04,264 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 00:07:04,265 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-22 00:07:04,265 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 00:07:04,265 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 00:07:04,265 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 00:07:04,266 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-22 00:07:04,266 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:04,266 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:04,266 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:04,266 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:04,266 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70/cf/e9dc74cd083d41d9a3c80e1899c7c70f to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70/cf/e9dc74cd083d41d9a3c80e1899c7c70f 2023-07-22 00:07:04,267 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480/cf/23eda588a3ea4d40aa4d0dd0dde5a628 to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480/cf/23eda588a3ea4d40aa4d0dd0dde5a628 2023-07-22 00:07:04,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-22 00:07:04,270 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480/recovered.edits/9.seqid to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480/recovered.edits/9.seqid 2023-07-22 00:07:04,271 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/610be6a22f5970e11999bf11c835a480 2023-07-22 00:07:04,271 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70/recovered.edits/9.seqid to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70/recovered.edits/9.seqid 2023-07-22 00:07:04,272 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemState/2d57d9576d990d45a48f1722273caf70 2023-07-22 00:07:04,272 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-22 00:07:04,275 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 00:07:04,277 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-22 00:07:04,280 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-22 00:07:04,281 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 00:07:04,281 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-22 00:07:04,281 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984424281"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:04,281 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984424281"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:04,283 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 00:07:04,283 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2d57d9576d990d45a48f1722273caf70, NAME => 'testtb-testExportFileSystemState,,1689984407658.2d57d9576d990d45a48f1722273caf70.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 610be6a22f5970e11999bf11c835a480, NAME => 'testtb-testExportFileSystemState,1,1689984407658.610be6a22f5970e11999bf11c835a480.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 00:07:04,283 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-22 00:07:04,283 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689984424283"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:04,285 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-22 00:07:04,287 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-22 00:07:04,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 38 msec 2023-07-22 00:07:04,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-22 00:07:04,369 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-22 00:07:04,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-22 00:07:04,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-22 00:07:04,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-22 00:07:04,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-22 00:07:04,411 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=768 (was 753) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1362665023_1 at /127.0.0.1:57404 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1951 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1699920953_17 at /127.0.0.1:52956 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1699920953_17 at /127.0.0.1:37258 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1699920953_17 at /127.0.0.1:57418 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:35881 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 913) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=332 (was 335), ProcessCount=178 (was 178), AvailableMemoryMB=7538 (was 7688) 2023-07-22 00:07:04,411 WARN [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-22 00:07:04,437 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=768, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=332, ProcessCount=178, AvailableMemoryMB=7538 2023-07-22 00:07:04,437 WARN [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-22 00:07:04,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 00:07:04,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-22 00:07:04,443 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:07:04,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-22 00:07:04,444 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:07:04,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 00:07:04,449 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e 2023-07-22 00:07:04,450 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d 2023-07-22 00:07:04,450 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e empty. 2023-07-22 00:07:04,450 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d empty. 2023-07-22 00:07:04,451 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e 2023-07-22 00:07:04,451 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d 2023-07-22 00:07:04,451 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-22 00:07:04,471 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-22 00:07:04,472 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 331927ff9715ad5dd7522b299a44124e, NAME => 'testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp 2023-07-22 00:07:04,472 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => b6e486777ebfa3bb081e2ae1529d161d, NAME => 'testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp 2023-07-22 00:07:04,512 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:04,512 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 331927ff9715ad5dd7522b299a44124e, disabling compactions & flushes 2023-07-22 00:07:04,513 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. 2023-07-22 00:07:04,513 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. 2023-07-22 00:07:04,513 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. after waiting 0 ms 2023-07-22 00:07:04,513 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. 2023-07-22 00:07:04,513 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. 2023-07-22 00:07:04,513 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 331927ff9715ad5dd7522b299a44124e: 2023-07-22 00:07:04,515 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:04,515 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing b6e486777ebfa3bb081e2ae1529d161d, disabling compactions & flushes 2023-07-22 00:07:04,516 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. 2023-07-22 00:07:04,516 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. 2023-07-22 00:07:04,516 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. after waiting 0 ms 2023-07-22 00:07:04,516 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. 2023-07-22 00:07:04,516 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. 2023-07-22 00:07:04,516 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for b6e486777ebfa3bb081e2ae1529d161d: 2023-07-22 00:07:04,519 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:07:04,520 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984424520"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984424520"}]},"ts":"1689984424520"} 2023-07-22 00:07:04,520 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984424520"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984424520"}]},"ts":"1689984424520"} 2023-07-22 00:07:04,523 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 00:07:04,524 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:07:04,525 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984424525"}]},"ts":"1689984424525"} 2023-07-22 00:07:04,527 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-22 00:07:04,535 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:07:04,538 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:07:04,538 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:07:04,538 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:07:04,538 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:07:04,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=331927ff9715ad5dd7522b299a44124e, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b6e486777ebfa3bb081e2ae1529d161d, ASSIGN}] 2023-07-22 00:07:04,544 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=331927ff9715ad5dd7522b299a44124e, ASSIGN 2023-07-22 00:07:04,544 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b6e486777ebfa3bb081e2ae1529d161d, ASSIGN 2023-07-22 00:07:04,546 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b6e486777ebfa3bb081e2ae1529d161d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43309,1689984379801; forceNewPlan=false, retain=false 2023-07-22 00:07:04,546 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=331927ff9715ad5dd7522b299a44124e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40519,1689984379684; forceNewPlan=false, retain=false 2023-07-22 00:07:04,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 00:07:04,696 INFO [jenkins-hbase4:42695] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 00:07:04,699 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=331927ff9715ad5dd7522b299a44124e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:04,699 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=b6e486777ebfa3bb081e2ae1529d161d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:04,700 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984424699"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984424699"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984424699"}]},"ts":"1689984424699"} 2023-07-22 00:07:04,700 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984424699"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984424699"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984424699"}]},"ts":"1689984424699"} 2023-07-22 00:07:04,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure b6e486777ebfa3bb081e2ae1529d161d, server=jenkins-hbase4.apache.org,43309,1689984379801}] 2023-07-22 00:07:04,704 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 331927ff9715ad5dd7522b299a44124e, server=jenkins-hbase4.apache.org,40519,1689984379684}] 2023-07-22 00:07:04,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 00:07:04,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. 2023-07-22 00:07:04,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b6e486777ebfa3bb081e2ae1529d161d, NAME => 'testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 00:07:04,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. service=AccessControlService 2023-07-22 00:07:04,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:07:04,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports b6e486777ebfa3bb081e2ae1529d161d 2023-07-22 00:07:04,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. 2023-07-22 00:07:04,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:04,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 331927ff9715ad5dd7522b299a44124e, NAME => 'testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 00:07:04,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b6e486777ebfa3bb081e2ae1529d161d 2023-07-22 00:07:04,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b6e486777ebfa3bb081e2ae1529d161d 2023-07-22 00:07:04,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. service=AccessControlService 2023-07-22 00:07:04,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:07:04,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 331927ff9715ad5dd7522b299a44124e 2023-07-22 00:07:04,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:04,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 331927ff9715ad5dd7522b299a44124e 2023-07-22 00:07:04,865 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 331927ff9715ad5dd7522b299a44124e 2023-07-22 00:07:04,868 INFO [StoreOpener-b6e486777ebfa3bb081e2ae1529d161d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b6e486777ebfa3bb081e2ae1529d161d 2023-07-22 00:07:04,868 INFO [StoreOpener-331927ff9715ad5dd7522b299a44124e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 331927ff9715ad5dd7522b299a44124e 2023-07-22 00:07:04,869 DEBUG [StoreOpener-b6e486777ebfa3bb081e2ae1529d161d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d/cf 2023-07-22 00:07:04,869 DEBUG [StoreOpener-b6e486777ebfa3bb081e2ae1529d161d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d/cf 2023-07-22 00:07:04,870 DEBUG [StoreOpener-331927ff9715ad5dd7522b299a44124e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e/cf 2023-07-22 00:07:04,870 INFO [StoreOpener-b6e486777ebfa3bb081e2ae1529d161d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6e486777ebfa3bb081e2ae1529d161d columnFamilyName cf 2023-07-22 00:07:04,870 DEBUG [StoreOpener-331927ff9715ad5dd7522b299a44124e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e/cf 2023-07-22 00:07:04,870 INFO [StoreOpener-331927ff9715ad5dd7522b299a44124e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 331927ff9715ad5dd7522b299a44124e columnFamilyName cf 2023-07-22 00:07:04,871 INFO [StoreOpener-b6e486777ebfa3bb081e2ae1529d161d-1] regionserver.HStore(310): Store=b6e486777ebfa3bb081e2ae1529d161d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:07:04,871 INFO [StoreOpener-331927ff9715ad5dd7522b299a44124e-1] regionserver.HStore(310): Store=331927ff9715ad5dd7522b299a44124e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:07:04,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d 2023-07-22 00:07:04,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e 2023-07-22 00:07:04,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d 2023-07-22 00:07:04,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e 2023-07-22 00:07:04,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b6e486777ebfa3bb081e2ae1529d161d 2023-07-22 00:07:04,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 331927ff9715ad5dd7522b299a44124e 2023-07-22 00:07:04,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:07:04,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b6e486777ebfa3bb081e2ae1529d161d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59566314, jitterRate=-0.11239275336265564}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:07:04,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b6e486777ebfa3bb081e2ae1529d161d: 2023-07-22 00:07:04,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d., pid=45, masterSystemTime=1689984424855 2023-07-22 00:07:04,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. 2023-07-22 00:07:04,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. 2023-07-22 00:07:04,883 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=b6e486777ebfa3bb081e2ae1529d161d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:04,884 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984424883"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984424883"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984424883"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984424883"}]},"ts":"1689984424883"} 2023-07-22 00:07:04,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:07:04,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 331927ff9715ad5dd7522b299a44124e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73421790, jitterRate=0.09406992793083191}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:07:04,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 331927ff9715ad5dd7522b299a44124e: 2023-07-22 00:07:04,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e., pid=46, masterSystemTime=1689984424856 2023-07-22 00:07:04,889 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-22 00:07:04,889 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure b6e486777ebfa3bb081e2ae1529d161d, server=jenkins-hbase4.apache.org,43309,1689984379801 in 184 msec 2023-07-22 00:07:04,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. 2023-07-22 00:07:04,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. 2023-07-22 00:07:04,892 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b6e486777ebfa3bb081e2ae1529d161d, ASSIGN in 351 msec 2023-07-22 00:07:04,892 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=331927ff9715ad5dd7522b299a44124e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:04,892 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984424892"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984424892"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984424892"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984424892"}]},"ts":"1689984424892"} 2023-07-22 00:07:04,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-22 00:07:04,897 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 331927ff9715ad5dd7522b299a44124e, server=jenkins-hbase4.apache.org,40519,1689984379684 in 190 msec 2023-07-22 00:07:04,900 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-22 00:07:04,900 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=331927ff9715ad5dd7522b299a44124e, ASSIGN in 359 msec 2023-07-22 00:07:04,901 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:07:04,902 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984424901"}]},"ts":"1689984424901"} 2023-07-22 00:07:04,904 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-22 00:07:04,907 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:07:04,907 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-22 00:07:04,910 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40519] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 00:07:04,912 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:04,912 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:04,912 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:04,912 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:04,913 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:04,914 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:04,914 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:04,914 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:04,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 475 msec 2023-07-22 00:07:04,994 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-22 00:07:05,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-22 00:07:05,049 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-22 00:07:05,050 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-22 00:07:05,050 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:07:05,053 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-22 00:07:05,053 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:07:05,053 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-22 00:07:05,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 00:07:05,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984425056 (current time:1689984425056). 2023-07-22 00:07:05,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:07:05,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x4adb84c2 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:05,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b750151, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:05,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:05,066 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:05,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4adb84c2 to 127.0.0.1:58666 2023-07-22 00:07:05,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:05,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x1478d7ee to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:05,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@293bc37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:05,076 DEBUG [hconnection-0x11ff4abd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:05,078 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:05,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1478d7ee to 127.0.0.1:58666 2023-07-22 00:07:05,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:05,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 00:07:05,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:07:05,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 00:07:05,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 00:07:05,087 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 00:07:05,088 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689985025088 2023-07-22 00:07:05,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 00:07:05,088 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-22 00:07:05,089 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:07:05,089 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:07:05,090 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 00:07:05,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 00:07:05,092 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-22 00:07:05,093 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 00:07:05,093 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689985025093 2023-07-22 00:07:05,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,112 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-22 00:07:05,112 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:05,114 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-22 00:07:05,114 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-22 00:07:05,114 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,114 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,117 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,117 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,117 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,117 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,118 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,118 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 00:07:05,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,119 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 00:07:05,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 00:07:05,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-22 00:07:05,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,119 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,119 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,119 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 00:07:05,119 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 00:07:05,119 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:07:05,119 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 00:07:05,119 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:05,119 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,120 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 00:07:05,120 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,121 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 00:07:05,121 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 00:07:05,121 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:05,121 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 00:07:05,121 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:05,123 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 00:07:05,123 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 00:07:05,126 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 00:07:05,126 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 00:07:05,126 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-22 00:07:05,126 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 00:07:05,126 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-22 00:07:05,128 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,128 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,128 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,129 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,129 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,129 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,129 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,129 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,132 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-22 00:07:05,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48aa38a9[Count = 1] remaining members to acquire global barrier 2023-07-22 00:07:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,132 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,132 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-22 00:07:05,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48aa38a9[Count = 0] remaining members to acquire global barrier 2023-07-22 00:07:05,135 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-22 00:07:05,135 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,136 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,136 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,137 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 00:07:05,137 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 00:07:05,137 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,137 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:05,137 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:05,137 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,137 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:07:05,137 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. 2023-07-22 00:07:05,137 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,137 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:05,138 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. 2023-07-22 00:07:05,137 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. started... 2023-07-22 00:07:05,138 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. started... 2023-07-22 00:07:05,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,138 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:05,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,139 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 00:07:05,139 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 331927ff9715ad5dd7522b299a44124e: 2023-07-22 00:07:05,139 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 00:07:05,140 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35499,1689984379745' in zk 2023-07-22 00:07:05,139 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b6e486777ebfa3bb081e2ae1529d161d: 2023-07-22 00:07:05,140 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,140 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,140 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:05,140 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:05,140 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:07:05,140 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:07:05,147 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 00:07:05,147 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:05,147 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 00:07:05,159 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. completed. 2023-07-22 00:07:05,159 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. 2023-07-22 00:07:05,160 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:05,160 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:05,160 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,160 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 00:07:05,160 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40519,1689984379684' in zk 2023-07-22 00:07:05,161 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. completed. 2023-07-22 00:07:05,161 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. 2023-07-22 00:07:05,161 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:05,161 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:05,161 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,161 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-22 00:07:05,161 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43309,1689984379801' in zk 2023-07-22 00:07:05,162 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 00:07:05,162 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:05,162 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,162 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 00:07:05,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,165 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,165 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 00:07:05,165 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:05,165 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-22 00:07:05,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40519,1689984379684': 2023-07-22 00:07:05,174 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-22 00:07:05,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43309,1689984379801': 2023-07-22 00:07:05,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-22 00:07:05,181 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-22 00:07:05,181 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:07:05,181 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:07:05,181 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,181 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:07:05,183 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,184 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,184 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,185 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,185 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,185 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,185 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,185 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,186 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,187 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,189 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:05,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,190 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 00:07:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:05,191 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:07:05,191 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,191 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,196 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,196 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,196 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,196 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,196 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,197 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,196 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,197 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:05,196 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,196 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,200 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,200 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,200 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,200 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,200 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,200 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,200 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,200 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,200 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,266 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-22 00:07:05,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,267 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:05,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689984425088Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689984425197 (+109 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689984425197Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689984425203 (+6 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689984425213 (+10 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689984425266 (+53 ms) 2023-07-22 00:07:05,270 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 00:07:05,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 181 msec 2023-07-22 00:07:05,391 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:05,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 00:07:05,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:07:05,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40519] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:07:05,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43309] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:07:05,405 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-22 00:07:05,405 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. 2023-07-22 00:07:05,405 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:07:05,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 00:07:05,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984425416 (current time:1689984425416). 2023-07-22 00:07:05,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:07:05,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x7c3aee53 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:05,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22318784, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:05,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:05,436 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:05,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c3aee53 to 127.0.0.1:58666 2023-07-22 00:07:05,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:05,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x416325d0 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:05,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a8003d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:05,450 DEBUG [hconnection-0x4423a4aa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:05,451 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:05,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x416325d0 to 127.0.0.1:58666 2023-07-22 00:07:05,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:05,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-22 00:07:05,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:07:05,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 00:07:05,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 00:07:05,466 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 00:07:05,468 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689985025468 2023-07-22 00:07:05,468 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-22 00:07:05,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-22 00:07:05,469 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:07:05,469 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:07:05,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 00:07:05,470 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-22 00:07:05,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-22 00:07:05,473 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 00:07:05,474 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689985025474 2023-07-22 00:07:05,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-22 00:07:05,500 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-22 00:07:05,500 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:05,502 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-22 00:07:05,502 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-22 00:07:05,563 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,564 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,565 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,565 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,565 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,565 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,565 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,566 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,566 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,566 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:07:05,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,570 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:05,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 00:07:05,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 00:07:05,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,570 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 00:07:05,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-22 00:07:05,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,570 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 00:07:05,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 00:07:05,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 00:07:05,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:05,571 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 00:07:05,571 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-22 00:07:05,571 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:05,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 00:07:05,571 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:07:05,573 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 00:07:05,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-22 00:07:05,571 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 00:07:05,573 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-22 00:07:05,573 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:05,573 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:05,573 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 00:07:05,576 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 00:07:05,576 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 00:07:05,575 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-22 00:07:05,576 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 00:07:05,576 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 00:07:05,576 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-22 00:07:05,576 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-22 00:07:05,578 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,578 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,578 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,582 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,582 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,582 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,582 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:05,582 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,582 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:05,582 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,582 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:05,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-22 00:07:05,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46122018[Count = 1] remaining members to acquire global barrier 2023-07-22 00:07:05,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-22 00:07:05,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46122018[Count = 0] remaining members to acquire global barrier 2023-07-22 00:07:05,586 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-22 00:07:05,586 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,587 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,587 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,587 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,588 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 00:07:05,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,588 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,588 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 00:07:05,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,588 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 00:07:05,588 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-22 00:07:05,588 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:05,588 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:05,588 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,588 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. 2023-07-22 00:07:05,588 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35499,1689984379745' in zk 2023-07-22 00:07:05,588 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. started... 2023-07-22 00:07:05,588 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. 2023-07-22 00:07:05,588 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:05,588 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:05,588 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:07:05,589 INFO [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b6e486777ebfa3bb081e2ae1529d161d 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-22 00:07:05,588 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. started... 2023-07-22 00:07:05,589 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 331927ff9715ad5dd7522b299a44124e 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-22 00:07:05,590 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 00:07:05,590 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:05,590 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 00:07:05,611 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e/.tmp/cf/a2ff75406d2e4b638f862278535ec3cd 2023-07-22 00:07:05,611 INFO [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d/.tmp/cf/08bfdcf0fb9a4712a39a54712d3ff8a2 2023-07-22 00:07:05,619 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d/.tmp/cf/08bfdcf0fb9a4712a39a54712d3ff8a2 as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d/cf/08bfdcf0fb9a4712a39a54712d3ff8a2 2023-07-22 00:07:05,620 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e/.tmp/cf/a2ff75406d2e4b638f862278535ec3cd as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e/cf/a2ff75406d2e4b638f862278535ec3cd 2023-07-22 00:07:05,624 INFO [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d/cf/08bfdcf0fb9a4712a39a54712d3ff8a2, entries=48, sequenceid=6, filesize=8.1 K 2023-07-22 00:07:05,625 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e/cf/a2ff75406d2e4b638f862278535ec3cd, entries=2, sequenceid=6, filesize=5.0 K 2023-07-22 00:07:05,625 INFO [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for b6e486777ebfa3bb081e2ae1529d161d in 37ms, sequenceid=6, compaction requested=false 2023-07-22 00:07:05,627 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b6e486777ebfa3bb081e2ae1529d161d: 2023-07-22 00:07:05,627 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-22 00:07:05,627 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 331927ff9715ad5dd7522b299a44124e in 38ms, sequenceid=6, compaction requested=false 2023-07-22 00:07:05,627 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:05,627 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 331927ff9715ad5dd7522b299a44124e: 2023-07-22 00:07:05,627 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d/cf/08bfdcf0fb9a4712a39a54712d3ff8a2] hfiles 2023-07-22 00:07:05,627 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d/cf/08bfdcf0fb9a4712a39a54712d3ff8a2 for snapshot=snaptb0-testConsecutiveExports 2023-07-22 00:07:05,627 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-22 00:07:05,627 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:05,627 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e/cf/a2ff75406d2e4b638f862278535ec3cd] hfiles 2023-07-22 00:07:05,627 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e/cf/a2ff75406d2e4b638f862278535ec3cd for snapshot=snaptb0-testConsecutiveExports 2023-07-22 00:07:05,639 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. completed. 2023-07-22 00:07:05,639 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. 2023-07-22 00:07:05,639 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:05,639 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:05,639 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,640 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 00:07:05,640 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43309,1689984379801' in zk 2023-07-22 00:07:05,641 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. completed. 2023-07-22 00:07:05,641 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. 2023-07-22 00:07:05,641 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:05,641 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:05,641 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,641 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-22 00:07:05,641 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40519,1689984379684' in zk 2023-07-22 00:07:05,643 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 00:07:05,643 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,643 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-22 00:07:05,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,643 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:05,643 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:05,645 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 00:07:05,643 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,644 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-22 00:07:05,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40519,1689984379684': 2023-07-22 00:07:05,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-22 00:07:05,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43309,1689984379801': 2023-07-22 00:07:05,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-22 00:07:05,656 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-22 00:07:05,656 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:07:05,656 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:07:05,656 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-22 00:07:05,657 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:07:05,660 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,660 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,660 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,660 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,660 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,660 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,660 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,661 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,661 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,662 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:05,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:05,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:05,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:05,664 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,666 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,667 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:05,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-22 00:07:05,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,674 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,674 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,674 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,674 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,674 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-22 00:07:05,674 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-22 00:07:05,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,674 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:05,674 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:05,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,674 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:05,674 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,675 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,677 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,677 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,677 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,677 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,677 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:05,677 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,677 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:05,674 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:05,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:05,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:05,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:05,679 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports because node does not exist (not an error) 2023-07-22 00:07:05,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,754 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-22 00:07:05,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,754 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689984425468Consolidate snapshot: snaptb0-testConsecutiveExports at 1689984425674 (+206 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689984425674Writing data manifest for snaptb0-testConsecutiveExports at 1689984425681 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689984425704 (+23 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689984425754 (+50 ms) 2023-07-22 00:07:05,758 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-22 00:07:05,760 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 289 msec 2023-07-22 00:07:05,773 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:05,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-22 00:07:05,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:07:05,775 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775 2023-07-22 00:07:05,775 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775, srcFsUri=hdfs://localhost:34573, srcDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:07:05,802 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34573, inputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:07:05,802 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3365b688, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,802 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34573, inputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d, snapshotDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-22 00:07:05,811 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 00:07:05,831 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:05,832 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:05,833 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:05,833 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:05,833 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:05,834 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:05,834 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:05,916 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/hadoop-3829383639088996261.jar 2023-07-22 00:07:05,917 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:05,917 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:05,918 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:05,918 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:05,919 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:05,919 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:05,919 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 00:07:05,920 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 00:07:05,920 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 00:07:05,920 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 00:07:05,921 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 00:07:05,921 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 00:07:05,922 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 00:07:05,922 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 00:07:05,922 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 00:07:05,923 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 00:07:05,923 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:05,924 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:05,924 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:05,924 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:05,924 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:05,925 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:05,925 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:06,456 WARN [Listener at jenkins-hbase4.apache.org/40445] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 00:07:06,459 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-22 00:07:06,461 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-22 00:07:08,692 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:07:08,692 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:07:08,695 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0002_000001 (auth:SIMPLE) 2023-07-22 00:07:09,137 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0003_000001 (auth:SIMPLE) 2023-07-22 00:07:09,722 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 00:07:13,734 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0003_000001 (auth:SIMPLE) 2023-07-22 00:07:15,963 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0003_000001 (auth:SIMPLE) 2023-07-22 00:07:18,717 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0003_000001 (auth:SIMPLE) 2023-07-22 00:07:20,741 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 00:07:20,742 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 00:07:20,745 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-22 00:07:20,745 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 00:07:20,746 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 00:07:20,746 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1699920953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 00:07:20,748 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 00:07:20,748 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 00:07:20,748 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@32c699b6 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 00:07:20,749 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 00:07:20,749 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 00:07:20,750 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775, srcFsUri=hdfs://localhost:34573, srcDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:07:20,775 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34573, inputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:07:20,775 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@2ca21fab, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 00:07:20,775 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34573, inputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d, snapshotDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-22 00:07:20,785 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-22 00:07:20,796 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,797 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,797 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,797 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,798 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,798 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,798 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,871 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/hadoop-595697226749157916.jar 2023-07-22 00:07:20,871 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,872 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,872 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,873 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,873 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,873 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:20,874 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 00:07:20,874 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 00:07:20,874 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 00:07:20,875 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 00:07:20,875 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 00:07:20,875 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 00:07:20,876 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 00:07:20,876 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 00:07:20,876 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 00:07:20,877 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 00:07:20,877 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:20,877 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:20,878 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:20,878 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:20,878 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:20,879 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:20,879 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:21,322 WARN [Listener at jenkins-hbase4.apache.org/40445] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 00:07:21,325 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-22 00:07:21,327 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-22 00:07:24,890 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:07:24,891 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:07:24,894 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0003_000001 (auth:SIMPLE) 2023-07-22 00:07:25,706 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0004_000001 (auth:SIMPLE) 2023-07-22 00:07:30,267 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0004_000001 (auth:SIMPLE) 2023-07-22 00:07:32,490 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0004_000001 (auth:SIMPLE) 2023-07-22 00:07:35,840 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0004_000001 (auth:SIMPLE) 2023-07-22 00:07:37,551 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 00:07:37,551 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 00:07:37,554 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-22 00:07:37,554 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 00:07:37,554 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 00:07:37,554 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1699920953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 00:07:37,558 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 00:07:37,558 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 00:07:37,558 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@32c699b6 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-22 00:07:37,559 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-22 00:07:37,559 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/local-export-1689984425775/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-22 00:07:37,586 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-22 00:07:37,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-22 00:07:37,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-22 00:07:37,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 00:07:37,594 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984457594"}]},"ts":"1689984457594"} 2023-07-22 00:07:37,596 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-22 00:07:37,598 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-22 00:07:37,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=331927ff9715ad5dd7522b299a44124e, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b6e486777ebfa3bb081e2ae1529d161d, UNASSIGN}] 2023-07-22 00:07:37,601 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b6e486777ebfa3bb081e2ae1529d161d, UNASSIGN 2023-07-22 00:07:37,602 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=331927ff9715ad5dd7522b299a44124e, UNASSIGN 2023-07-22 00:07:37,603 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=331927ff9715ad5dd7522b299a44124e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:37,603 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b6e486777ebfa3bb081e2ae1529d161d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:37,603 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984457603"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984457603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984457603"}]},"ts":"1689984457603"} 2023-07-22 00:07:37,603 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984457603"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984457603"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984457603"}]},"ts":"1689984457603"} 2023-07-22 00:07:37,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 331927ff9715ad5dd7522b299a44124e, server=jenkins-hbase4.apache.org,40519,1689984379684}] 2023-07-22 00:07:37,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure b6e486777ebfa3bb081e2ae1529d161d, server=jenkins-hbase4.apache.org,43309,1689984379801}] 2023-07-22 00:07:37,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 00:07:37,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 331927ff9715ad5dd7522b299a44124e 2023-07-22 00:07:37,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 331927ff9715ad5dd7522b299a44124e, disabling compactions & flushes 2023-07-22 00:07:37,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. 2023-07-22 00:07:37,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. 2023-07-22 00:07:37,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. after waiting 0 ms 2023-07-22 00:07:37,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. 2023-07-22 00:07:37,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b6e486777ebfa3bb081e2ae1529d161d 2023-07-22 00:07:37,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b6e486777ebfa3bb081e2ae1529d161d, disabling compactions & flushes 2023-07-22 00:07:37,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. 2023-07-22 00:07:37,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. 2023-07-22 00:07:37,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. after waiting 0 ms 2023-07-22 00:07:37,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. 2023-07-22 00:07:37,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:07:37,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:07:37,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:07:37,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:07:37,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d. 2023-07-22 00:07:37,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b6e486777ebfa3bb081e2ae1529d161d: 2023-07-22 00:07:37,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e. 2023-07-22 00:07:37,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 331927ff9715ad5dd7522b299a44124e: 2023-07-22 00:07:37,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b6e486777ebfa3bb081e2ae1529d161d 2023-07-22 00:07:37,776 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b6e486777ebfa3bb081e2ae1529d161d, regionState=CLOSED 2023-07-22 00:07:37,777 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984457776"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984457776"}]},"ts":"1689984457776"} 2023-07-22 00:07:37,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 331927ff9715ad5dd7522b299a44124e 2023-07-22 00:07:37,777 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=331927ff9715ad5dd7522b299a44124e, regionState=CLOSED 2023-07-22 00:07:37,777 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689984457777"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984457777"}]},"ts":"1689984457777"} 2023-07-22 00:07:37,780 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-22 00:07:37,780 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure b6e486777ebfa3bb081e2ae1529d161d, server=jenkins-hbase4.apache.org,43309,1689984379801 in 173 msec 2023-07-22 00:07:37,781 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-22 00:07:37,781 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b6e486777ebfa3bb081e2ae1529d161d, UNASSIGN in 181 msec 2023-07-22 00:07:37,781 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 331927ff9715ad5dd7522b299a44124e, server=jenkins-hbase4.apache.org,40519,1689984379684 in 175 msec 2023-07-22 00:07:37,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-22 00:07:37,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=331927ff9715ad5dd7522b299a44124e, UNASSIGN in 182 msec 2023-07-22 00:07:37,784 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984457784"}]},"ts":"1689984457784"} 2023-07-22 00:07:37,785 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-22 00:07:37,787 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-22 00:07:37,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 200 msec 2023-07-22 00:07:37,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-22 00:07:37,897 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-22 00:07:37,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-22 00:07:37,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 00:07:37,904 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 00:07:37,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-22 00:07:37,906 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 00:07:37,910 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40519] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-22 00:07:37,917 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e 2023-07-22 00:07:37,917 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d 2023-07-22 00:07:37,920 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 00:07:37,920 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 00:07:37,920 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 00:07:37,920 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 00:07:37,920 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 00:07:37,920 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 00:07:37,921 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 00:07:37,921 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-22 00:07:37,921 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e/cf, FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e/recovered.edits] 2023-07-22 00:07:37,922 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 00:07:37,922 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d/cf, FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d/recovered.edits] 2023-07-22 00:07:37,922 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 00:07:37,922 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:37,922 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:37,922 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 00:07:37,922 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:37,923 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-22 00:07:37,923 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:37,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-22 00:07:37,936 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d/cf/08bfdcf0fb9a4712a39a54712d3ff8a2 to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d/cf/08bfdcf0fb9a4712a39a54712d3ff8a2 2023-07-22 00:07:37,937 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e/cf/a2ff75406d2e4b638f862278535ec3cd to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e/cf/a2ff75406d2e4b638f862278535ec3cd 2023-07-22 00:07:37,942 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d/recovered.edits/9.seqid to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d/recovered.edits/9.seqid 2023-07-22 00:07:37,944 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e/recovered.edits/9.seqid to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e/recovered.edits/9.seqid 2023-07-22 00:07:37,944 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/b6e486777ebfa3bb081e2ae1529d161d 2023-07-22 00:07:37,944 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testConsecutiveExports/331927ff9715ad5dd7522b299a44124e 2023-07-22 00:07:37,944 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-22 00:07:37,947 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 00:07:37,969 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-22 00:07:37,981 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-22 00:07:37,983 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 00:07:37,983 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-22 00:07:37,984 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984457983"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:37,984 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984457983"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:38,000 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 00:07:38,000 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 331927ff9715ad5dd7522b299a44124e, NAME => 'testtb-testConsecutiveExports,,1689984424439.331927ff9715ad5dd7522b299a44124e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b6e486777ebfa3bb081e2ae1529d161d, NAME => 'testtb-testConsecutiveExports,1,1689984424439.b6e486777ebfa3bb081e2ae1529d161d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 00:07:38,000 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-22 00:07:38,000 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689984458000"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:38,003 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-22 00:07:38,009 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-22 00:07:38,011 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 110 msec 2023-07-22 00:07:38,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-22 00:07:38,027 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-22 00:07:38,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-22 00:07:38,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-22 00:07:38,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-22 00:07:38,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-22 00:07:38,097 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=748 (was 768), OpenFileDescriptor=894 (was 916), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=480 (was 332) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=7625 (was 7538) - AvailableMemoryMB LEAK? - 2023-07-22 00:07:38,097 WARN [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-22 00:07:38,129 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=894, MaxFileDescriptor=60000, SystemLoadAverage=480, ProcessCount=180, AvailableMemoryMB=7623 2023-07-22 00:07:38,130 WARN [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-22 00:07:38,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 00:07:38,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,141 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:07:38,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-22 00:07:38,142 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:07:38,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 00:07:38,150 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363 2023-07-22 00:07:38,155 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363 empty. 2023-07-22 00:07:38,155 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649 2023-07-22 00:07:38,155 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363 2023-07-22 00:07:38,155 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649 empty. 2023-07-22 00:07:38,156 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649 2023-07-22 00:07:38,156 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-22 00:07:38,190 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-22 00:07:38,197 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0c8c04147180c7e9e403d9d5086be363, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp 2023-07-22 00:07:38,198 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => fbc1607751b85e3b4903d0be18981649, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp 2023-07-22 00:07:38,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 00:07:38,265 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:38,265 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing fbc1607751b85e3b4903d0be18981649, disabling compactions & flushes 2023-07-22 00:07:38,265 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. 2023-07-22 00:07:38,265 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. 2023-07-22 00:07:38,265 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. after waiting 0 ms 2023-07-22 00:07:38,265 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. 2023-07-22 00:07:38,265 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. 2023-07-22 00:07:38,265 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for fbc1607751b85e3b4903d0be18981649: 2023-07-22 00:07:38,266 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:38,266 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 0c8c04147180c7e9e403d9d5086be363, disabling compactions & flushes 2023-07-22 00:07:38,266 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. 2023-07-22 00:07:38,266 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. 2023-07-22 00:07:38,266 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. after waiting 0 ms 2023-07-22 00:07:38,266 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. 2023-07-22 00:07:38,266 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. 2023-07-22 00:07:38,267 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 0c8c04147180c7e9e403d9d5086be363: 2023-07-22 00:07:38,269 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:07:38,271 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984458270"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984458270"}]},"ts":"1689984458270"} 2023-07-22 00:07:38,271 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984458270"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984458270"}]},"ts":"1689984458270"} 2023-07-22 00:07:38,277 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 00:07:38,278 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:07:38,278 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984458278"}]},"ts":"1689984458278"} 2023-07-22 00:07:38,280 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-22 00:07:38,284 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:07:38,285 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:07:38,285 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:07:38,285 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:07:38,285 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:07:38,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c8c04147180c7e9e403d9d5086be363, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fbc1607751b85e3b4903d0be18981649, ASSIGN}] 2023-07-22 00:07:38,288 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fbc1607751b85e3b4903d0be18981649, ASSIGN 2023-07-22 00:07:38,288 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c8c04147180c7e9e403d9d5086be363, ASSIGN 2023-07-22 00:07:38,289 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fbc1607751b85e3b4903d0be18981649, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35499,1689984379745; forceNewPlan=false, retain=false 2023-07-22 00:07:38,289 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c8c04147180c7e9e403d9d5086be363, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40519,1689984379684; forceNewPlan=false, retain=false 2023-07-22 00:07:38,439 INFO [jenkins-hbase4:42695] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 00:07:38,442 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=0c8c04147180c7e9e403d9d5086be363, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:38,442 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=fbc1607751b85e3b4903d0be18981649, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:38,442 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984458442"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984458442"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984458442"}]},"ts":"1689984458442"} 2023-07-22 00:07:38,442 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984458442"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984458442"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984458442"}]},"ts":"1689984458442"} 2023-07-22 00:07:38,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure fbc1607751b85e3b4903d0be18981649, server=jenkins-hbase4.apache.org,35499,1689984379745}] 2023-07-22 00:07:38,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 00:07:38,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 0c8c04147180c7e9e403d9d5086be363, server=jenkins-hbase4.apache.org,40519,1689984379684}] 2023-07-22 00:07:38,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. 2023-07-22 00:07:38,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0c8c04147180c7e9e403d9d5086be363, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 00:07:38,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. service=AccessControlService 2023-07-22 00:07:38,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:07:38,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0c8c04147180c7e9e403d9d5086be363 2023-07-22 00:07:38,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:38,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0c8c04147180c7e9e403d9d5086be363 2023-07-22 00:07:38,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0c8c04147180c7e9e403d9d5086be363 2023-07-22 00:07:38,631 INFO [StoreOpener-0c8c04147180c7e9e403d9d5086be363-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0c8c04147180c7e9e403d9d5086be363 2023-07-22 00:07:38,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. 2023-07-22 00:07:38,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fbc1607751b85e3b4903d0be18981649, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 00:07:38,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. service=AccessControlService 2023-07-22 00:07:38,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:07:38,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion fbc1607751b85e3b4903d0be18981649 2023-07-22 00:07:38,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:38,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fbc1607751b85e3b4903d0be18981649 2023-07-22 00:07:38,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fbc1607751b85e3b4903d0be18981649 2023-07-22 00:07:38,638 DEBUG [StoreOpener-0c8c04147180c7e9e403d9d5086be363-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363/cf 2023-07-22 00:07:38,638 DEBUG [StoreOpener-0c8c04147180c7e9e403d9d5086be363-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363/cf 2023-07-22 00:07:38,639 INFO [StoreOpener-0c8c04147180c7e9e403d9d5086be363-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c8c04147180c7e9e403d9d5086be363 columnFamilyName cf 2023-07-22 00:07:38,640 INFO [StoreOpener-0c8c04147180c7e9e403d9d5086be363-1] regionserver.HStore(310): Store=0c8c04147180c7e9e403d9d5086be363/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:07:38,641 INFO [StoreOpener-fbc1607751b85e3b4903d0be18981649-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fbc1607751b85e3b4903d0be18981649 2023-07-22 00:07:38,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363 2023-07-22 00:07:38,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363 2023-07-22 00:07:38,644 DEBUG [StoreOpener-fbc1607751b85e3b4903d0be18981649-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649/cf 2023-07-22 00:07:38,644 DEBUG [StoreOpener-fbc1607751b85e3b4903d0be18981649-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649/cf 2023-07-22 00:07:38,644 INFO [StoreOpener-fbc1607751b85e3b4903d0be18981649-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbc1607751b85e3b4903d0be18981649 columnFamilyName cf 2023-07-22 00:07:38,645 INFO [StoreOpener-fbc1607751b85e3b4903d0be18981649-1] regionserver.HStore(310): Store=fbc1607751b85e3b4903d0be18981649/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:07:38,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649 2023-07-22 00:07:38,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0c8c04147180c7e9e403d9d5086be363 2023-07-22 00:07:38,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649 2023-07-22 00:07:38,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fbc1607751b85e3b4903d0be18981649 2023-07-22 00:07:38,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:07:38,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:07:38,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fbc1607751b85e3b4903d0be18981649; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68264970, jitterRate=0.01722732186317444}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:07:38,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fbc1607751b85e3b4903d0be18981649: 2023-07-22 00:07:38,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649., pid=60, masterSystemTime=1689984458599 2023-07-22 00:07:38,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. 2023-07-22 00:07:38,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. 2023-07-22 00:07:38,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0c8c04147180c7e9e403d9d5086be363; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73906268, jitterRate=0.10128921270370483}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:07:38,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0c8c04147180c7e9e403d9d5086be363: 2023-07-22 00:07:38,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363., pid=61, masterSystemTime=1689984458602 2023-07-22 00:07:38,678 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=fbc1607751b85e3b4903d0be18981649, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:38,678 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984458678"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984458678"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984458678"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984458678"}]},"ts":"1689984458678"} 2023-07-22 00:07:38,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. 2023-07-22 00:07:38,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. 2023-07-22 00:07:38,681 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=0c8c04147180c7e9e403d9d5086be363, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:38,681 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984458681"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984458681"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984458681"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984458681"}]},"ts":"1689984458681"} 2023-07-22 00:07:38,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-22 00:07:38,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure fbc1607751b85e3b4903d0be18981649, server=jenkins-hbase4.apache.org,35499,1689984379745 in 235 msec 2023-07-22 00:07:38,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-22 00:07:38,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 0c8c04147180c7e9e403d9d5086be363, server=jenkins-hbase4.apache.org,40519,1689984379684 in 235 msec 2023-07-22 00:07:38,686 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fbc1607751b85e3b4903d0be18981649, ASSIGN in 399 msec 2023-07-22 00:07:38,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-22 00:07:38,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c8c04147180c7e9e403d9d5086be363, ASSIGN in 400 msec 2023-07-22 00:07:38,693 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:07:38,693 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984458693"}]},"ts":"1689984458693"} 2023-07-22 00:07:38,704 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-22 00:07:38,709 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:07:38,710 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-22 00:07:38,713 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40519] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 00:07:38,715 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:38,715 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:38,715 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:38,715 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:38,718 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:38,718 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:38,718 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:38,718 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:38,721 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 586 msec 2023-07-22 00:07:38,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-22 00:07:38,750 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-22 00:07:38,751 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-22 00:07:38,751 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:07:38,770 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-22 00:07:38,770 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:07:38,770 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-22 00:07:38,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 00:07:38,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984458778 (current time:1689984458778). 2023-07-22 00:07:38,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:07:38,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x2d6e9e31 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:38,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fa2bcf4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:38,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:38,804 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:38,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d6e9e31 to 127.0.0.1:58666 2023-07-22 00:07:38,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:38,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x4469dcdf to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:38,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1daf5d75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:38,827 DEBUG [hconnection-0x27500728-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:38,830 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:38,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4469dcdf to 127.0.0.1:58666 2023-07-22 00:07:38,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:38,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 00:07:38,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:07:38,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 00:07:38,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 00:07:38,859 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 00:07:38,860 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689985058860 2023-07-22 00:07:38,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 00:07:38,861 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,863 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 00:07:38,874 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:07:38,874 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:07:38,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 00:07:38,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-07-22 00:07:38,878 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 00:07:38,880 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689985058880 2023-07-22 00:07:38,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,923 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-22 00:07:38,923 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:38,925 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-22 00:07:38,925 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-22 00:07:38,952 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,952 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,954 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:38,954 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:38,954 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:38,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:38,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:38,954 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:38,954 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:38,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:38,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:38,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:38,955 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:38,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:38,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,959 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:38,959 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:07:38,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 00:07:38,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 00:07:38,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,961 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 00:07:38,961 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 00:07:38,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-22 00:07:38,961 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,961 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 00:07:38,961 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 00:07:38,961 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:38,970 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 00:07:38,970 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 00:07:38,970 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 00:07:38,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,971 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 00:07:38,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,971 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:38,971 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 00:07:38,973 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:38,973 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 00:07:38,974 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 00:07:38,974 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 00:07:38,975 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:38,975 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 00:07:38,975 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 00:07:38,975 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 00:07:38,976 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:38,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:38,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:38,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:38,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 00:07:38,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:38,977 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,977 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:07:38,978 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:38,978 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:38,980 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,980 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:38,980 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,981 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:38,980 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:38,984 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,984 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:38,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:38,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:38,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:38,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:38,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 00:07:38,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b1a5c10[Count = 1] remaining members to acquire global barrier 2023-07-22 00:07:38,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:38,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:38,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:38,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:38,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:38,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:38,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:38,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:38,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:38,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 00:07:38,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b1a5c10[Count = 0] remaining members to acquire global barrier 2023-07-22 00:07:38,991 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-22 00:07:38,991 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,993 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,993 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,993 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,993 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 00:07:38,993 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:38,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,994 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 00:07:38,994 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:38,994 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. 2023-07-22 00:07:38,994 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 00:07:38,994 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:38,994 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. started... 2023-07-22 00:07:38,994 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:38,994 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:38,994 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:07:38,994 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:38,998 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0c8c04147180c7e9e403d9d5086be363: 2023-07-22 00:07:38,994 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. 2023-07-22 00:07:38,994 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 00:07:38,999 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43309,1689984379801' in zk 2023-07-22 00:07:38,999 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:38,999 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:38,999 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. started... 2023-07-22 00:07:38,999 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:07:39,001 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fbc1607751b85e3b4903d0be18981649: 2023-07-22 00:07:39,001 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,001 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:39,001 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:07:39,008 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 00:07:39,008 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:39,008 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 00:07:39,045 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. completed. 2023-07-22 00:07:39,045 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. 2023-07-22 00:07:39,045 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:39,046 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:39,046 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,046 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 00:07:39,046 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40519,1689984379684' in zk 2023-07-22 00:07:39,049 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,049 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 00:07:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:39,049 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:39,049 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 00:07:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:39,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:39,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40519,1689984379684': 2023-07-22 00:07:39,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-22 00:07:39,065 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. completed. 2023-07-22 00:07:39,065 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. 2023-07-22 00:07:39,066 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:39,066 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:39,066 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,066 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 00:07:39,066 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35499,1689984379745' in zk 2023-07-22 00:07:39,067 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 00:07:39,067 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,067 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:39,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:39,068 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 00:07:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:39,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:39,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35499,1689984379745': 2023-07-22 00:07:39,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-22 00:07:39,084 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-22 00:07:39,084 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:07:39,084 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:07:39,084 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,084 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:07:39,087 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,087 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:39,087 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,087 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,087 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,087 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:39,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:39,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,087 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:39,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:39,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:39,089 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:39,089 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,091 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:39,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:39,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:39,093 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,094 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:39,095 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,102 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:39,102 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:39,102 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:39,102 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:39,102 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,102 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:39,102 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,102 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:39,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,102 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,103 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,103 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,103 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,103 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,103 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:39,103 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,103 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,102 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:39,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:39,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:39,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:39,105 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:39,105 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:39,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:39,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:39,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:39,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:39,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:39,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:39,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:39,178 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:39,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 00:07:39,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:39,180 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 00:07:39,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-22 00:07:39,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,287 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689984458861Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689984459103 (+242 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689984459103Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689984459119 (+16 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689984459182 (+63 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689984459286 (+104 ms) 2023-07-22 00:07:39,293 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 00:07:39,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 432 msec 2023-07-22 00:07:39,480 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:39,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 00:07:39,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:07:39,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40519] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:07:39,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35499] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:07:39,519 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,519 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. 2023-07-22 00:07:39,520 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:07:39,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 00:07:39,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984459544 (current time:1689984459544). 2023-07-22 00:07:39,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:07:39,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x38636864 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:39,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@103664db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:39,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:39,573 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:39,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38636864 to 127.0.0.1:58666 2023-07-22 00:07:39,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:39,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x6a9b0417 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:39,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49986168, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:39,606 DEBUG [hconnection-0x6a2bc43c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:39,611 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:39,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a9b0417 to 127.0.0.1:58666 2023-07-22 00:07:39,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:39,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-22 00:07:39,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:07:39,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 00:07:39,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 00:07:39,634 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 00:07:39,638 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689985059638 2023-07-22 00:07:39,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-22 00:07:39,638 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,641 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:07:39,641 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:07:39,643 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-22 00:07:39,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 00:07:39,653 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 16 msec 2023-07-22 00:07:39,655 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 00:07:39,659 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689985059659 2023-07-22 00:07:39,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,741 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:39,741 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-22 00:07:39,741 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:39,743 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-22 00:07:39,743 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-22 00:07:39,743 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,743 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 00:07:39,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:39,744 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:07:39,745 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:39,745 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:39,745 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:39,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:39,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:39,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:39,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:39,746 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,747 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,747 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 00:07:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,747 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 00:07:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 00:07:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,748 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 00:07:39,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:39,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,748 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:39,748 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 00:07:39,748 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:39,748 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 00:07:39,750 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:39,748 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:07:39,750 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 00:07:39,752 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 00:07:39,752 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 00:07:39,752 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 00:07:39,752 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 00:07:39,753 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 00:07:39,755 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,756 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:39,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:39,756 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,756 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,756 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:39,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:39,757 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,757 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:39,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:39,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,758 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:39,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-22 00:07:39,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,759 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-22 00:07:39,759 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,759 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-22 00:07:39,759 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:39,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,764 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-22 00:07:39,765 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-22 00:07:39,765 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-22 00:07:39,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:39,767 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 00:07:39,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3760bce8[Count = 1] remaining members to acquire global barrier 2023-07-22 00:07:39,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:39,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:39,767 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:39,767 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,767 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:39,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:39,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:39,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:39,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-22 00:07:39,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3760bce8[Count = 0] remaining members to acquire global barrier 2023-07-22 00:07:39,770 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-22 00:07:39,770 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,775 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,775 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,775 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,775 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 00:07:39,775 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,775 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 00:07:39,775 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-22 00:07:39,776 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 00:07:39,776 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43309,1689984379801' in zk 2023-07-22 00:07:39,776 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,776 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:07:39,778 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:39,778 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. 2023-07-22 00:07:39,778 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:39,778 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. started... 2023-07-22 00:07:39,778 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:39,778 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:39,778 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0c8c04147180c7e9e403d9d5086be363 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-22 00:07:39,778 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. 2023-07-22 00:07:39,779 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. started... 2023-07-22 00:07:39,779 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 00:07:39,779 INFO [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fbc1607751b85e3b4903d0be18981649 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-22 00:07:39,779 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:39,779 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 00:07:39,814 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=467 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363/.tmp/cf/6d3e63dd6e8d4c42b14c472b58731649 2023-07-22 00:07:39,826 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363/.tmp/cf/6d3e63dd6e8d4c42b14c472b58731649 as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363/cf/6d3e63dd6e8d4c42b14c472b58731649 2023-07-22 00:07:39,833 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363/cf/6d3e63dd6e8d4c42b14c472b58731649, entries=7, sequenceid=6, filesize=5.3 K 2023-07-22 00:07:39,834 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 0c8c04147180c7e9e403d9d5086be363 in 56ms, sequenceid=6, compaction requested=false 2023-07-22 00:07:39,834 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-22 00:07:39,835 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0c8c04147180c7e9e403d9d5086be363: 2023-07-22 00:07:39,835 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,835 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:39,835 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363/cf/6d3e63dd6e8d4c42b14c472b58731649] hfiles 2023-07-22 00:07:39,835 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363/cf/6d3e63dd6e8d4c42b14c472b58731649 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,858 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. completed. 2023-07-22 00:07:39,858 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. 2023-07-22 00:07:39,859 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:39,859 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:39,859 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,859 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 00:07:39,859 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40519,1689984379684' in zk 2023-07-22 00:07:39,885 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,885 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 00:07:39,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:39,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:39,886 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:39,886 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 00:07:39,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:39,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:39,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:39,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:39,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:39,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:39,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:39,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:39,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40519,1689984379684': 2023-07-22 00:07:39,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-22 00:07:39,944 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:39,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 00:07:39,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:39,945 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 00:07:40,222 INFO [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.80 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649/.tmp/cf/143c3109e42c4fb9b456490a19ee0ab4 2023-07-22 00:07:40,232 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649/.tmp/cf/143c3109e42c4fb9b456490a19ee0ab4 as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649/cf/143c3109e42c4fb9b456490a19ee0ab4 2023-07-22 00:07:40,245 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:40,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 00:07:40,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:40,247 INFO [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649/cf/143c3109e42c4fb9b456490a19ee0ab4, entries=43, sequenceid=6, filesize=7.7 K 2023-07-22 00:07:40,247 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-22 00:07:40,248 INFO [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for fbc1607751b85e3b4903d0be18981649 in 469ms, sequenceid=6, compaction requested=false 2023-07-22 00:07:40,250 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fbc1607751b85e3b4903d0be18981649: 2023-07-22 00:07:40,250 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,250 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:40,250 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649/cf/143c3109e42c4fb9b456490a19ee0ab4] hfiles 2023-07-22 00:07:40,250 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649/cf/143c3109e42c4fb9b456490a19ee0ab4 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,283 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. completed. 2023-07-22 00:07:40,283 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. 2023-07-22 00:07:40,283 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:40,283 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:40,283 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:40,283 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-22 00:07:40,283 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35499,1689984379745' in zk 2023-07-22 00:07:40,301 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-22 00:07:40,301 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:40,301 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:40,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:40,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:40,301 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-22 00:07:40,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:40,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:40,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:40,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:40,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:40,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:40,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:40,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:40,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:40,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:40,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35499,1689984379745': 2023-07-22 00:07:40,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-22 00:07:40,307 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-22 00:07:40,307 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:07:40,307 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:07:40,307 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,307 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:07:40,341 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,341 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,342 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:40,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,342 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:40,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:40,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:40,343 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,343 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:40,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:40,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:40,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,343 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:40,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:40,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:40,346 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:40,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:40,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:40,346 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:40,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,347 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:40,349 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:40,350 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:40,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,350 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:40,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:40,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:40,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:40,353 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:40,353 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:40,353 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:40,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:40,354 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:40,354 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:40,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:40,354 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:40,354 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,354 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:40,354 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:40,354 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:40,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:40,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:40,354 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:40,354 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:40,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:40,354 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,356 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:40,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,356 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,357 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:40,357 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:40,357 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,357 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:40,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:40,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:40,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:40,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,480 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-22 00:07:40,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,481 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:07:40,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689984459638Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689984460356 (+718 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689984460357 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689984460362 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689984460385 (+23 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689984460480 (+95 ms) 2023-07-22 00:07:40,485 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-22 00:07:40,487 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 845 msec 2023-07-22 00:07:40,747 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:40,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-22 00:07:40,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:07:40,779 DEBUG [Listener at jenkins-hbase4.apache.org/40445] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 00:07:40,784 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54250, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 00:07:40,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35499] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 00:07:40,786 DEBUG [Listener at jenkins-hbase4.apache.org/40445] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 00:07:40,790 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 00:07:40,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40519] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 00:07:40,791 DEBUG [Listener at jenkins-hbase4.apache.org/40445] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-22 00:07:40,794 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-22 00:07:40,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43309] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-22 00:07:40,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 00:07:40,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:40,800 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:07:40,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-22 00:07:40,801 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:07:40,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 00:07:40,804 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe 2023-07-22 00:07:40,804 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2 2023-07-22 00:07:40,804 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe empty. 2023-07-22 00:07:40,804 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2 empty. 2023-07-22 00:07:40,805 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe 2023-07-22 00:07:40,805 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2 2023-07-22 00:07:40,805 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-22 00:07:40,818 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-22 00:07:40,819 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 85686a19842c38b6a7930c441a263ffe, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp 2023-07-22 00:07:40,820 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8dff301f9a703583ca77b131db141cc2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp 2023-07-22 00:07:40,834 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:40,835 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 85686a19842c38b6a7930c441a263ffe, disabling compactions & flushes 2023-07-22 00:07:40,835 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe. 2023-07-22 00:07:40,835 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe. 2023-07-22 00:07:40,835 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe. after waiting 0 ms 2023-07-22 00:07:40,835 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe. 2023-07-22 00:07:40,835 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe. 2023-07-22 00:07:40,835 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 85686a19842c38b6a7930c441a263ffe: 2023-07-22 00:07:40,836 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:40,836 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 8dff301f9a703583ca77b131db141cc2, disabling compactions & flushes 2023-07-22 00:07:40,836 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2. 2023-07-22 00:07:40,836 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2. 2023-07-22 00:07:40,836 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2. after waiting 0 ms 2023-07-22 00:07:40,836 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2. 2023-07-22 00:07:40,836 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2. 2023-07-22 00:07:40,836 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 8dff301f9a703583ca77b131db141cc2: 2023-07-22 00:07:40,841 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:07:40,842 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984460841"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984460841"}]},"ts":"1689984460841"} 2023-07-22 00:07:40,842 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984460841"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984460841"}]},"ts":"1689984460841"} 2023-07-22 00:07:40,844 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 00:07:40,847 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:07:40,847 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984460847"}]},"ts":"1689984460847"} 2023-07-22 00:07:40,848 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-22 00:07:40,852 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:07:40,853 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:07:40,853 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:07:40,853 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:07:40,853 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:07:40,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85686a19842c38b6a7930c441a263ffe, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8dff301f9a703583ca77b131db141cc2, ASSIGN}] 2023-07-22 00:07:40,856 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8dff301f9a703583ca77b131db141cc2, ASSIGN 2023-07-22 00:07:40,856 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85686a19842c38b6a7930c441a263ffe, ASSIGN 2023-07-22 00:07:40,859 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8dff301f9a703583ca77b131db141cc2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35499,1689984379745; forceNewPlan=false, retain=false 2023-07-22 00:07:40,860 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85686a19842c38b6a7930c441a263ffe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43309,1689984379801; forceNewPlan=false, retain=false 2023-07-22 00:07:40,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 00:07:41,009 INFO [jenkins-hbase4:42695] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 00:07:41,012 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=85686a19842c38b6a7930c441a263ffe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:41,012 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=8dff301f9a703583ca77b131db141cc2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:41,012 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984461012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984461012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984461012"}]},"ts":"1689984461012"} 2023-07-22 00:07:41,012 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984461012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984461012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984461012"}]},"ts":"1689984461012"} 2023-07-22 00:07:41,014 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 85686a19842c38b6a7930c441a263ffe, server=jenkins-hbase4.apache.org,43309,1689984379801}] 2023-07-22 00:07:41,015 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 8dff301f9a703583ca77b131db141cc2, server=jenkins-hbase4.apache.org,35499,1689984379745}] 2023-07-22 00:07:41,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 00:07:41,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe. 2023-07-22 00:07:41,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 85686a19842c38b6a7930c441a263ffe, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe.', STARTKEY => '', ENDKEY => '2'} 2023-07-22 00:07:41,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe. service=AccessControlService 2023-07-22 00:07:41,169 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:07:41,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 85686a19842c38b6a7930c441a263ffe 2023-07-22 00:07:41,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:41,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 85686a19842c38b6a7930c441a263ffe 2023-07-22 00:07:41,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 85686a19842c38b6a7930c441a263ffe 2023-07-22 00:07:41,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2. 2023-07-22 00:07:41,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8dff301f9a703583ca77b131db141cc2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2.', STARTKEY => '2', ENDKEY => ''} 2023-07-22 00:07:41,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2. service=AccessControlService 2023-07-22 00:07:41,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:07:41,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 8dff301f9a703583ca77b131db141cc2 2023-07-22 00:07:41,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:41,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8dff301f9a703583ca77b131db141cc2 2023-07-22 00:07:41,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8dff301f9a703583ca77b131db141cc2 2023-07-22 00:07:41,171 INFO [StoreOpener-85686a19842c38b6a7930c441a263ffe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 85686a19842c38b6a7930c441a263ffe 2023-07-22 00:07:41,172 INFO [StoreOpener-8dff301f9a703583ca77b131db141cc2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8dff301f9a703583ca77b131db141cc2 2023-07-22 00:07:41,173 DEBUG [StoreOpener-85686a19842c38b6a7930c441a263ffe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe/cf 2023-07-22 00:07:41,173 DEBUG [StoreOpener-85686a19842c38b6a7930c441a263ffe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe/cf 2023-07-22 00:07:41,173 INFO [StoreOpener-85686a19842c38b6a7930c441a263ffe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85686a19842c38b6a7930c441a263ffe columnFamilyName cf 2023-07-22 00:07:41,174 DEBUG [StoreOpener-8dff301f9a703583ca77b131db141cc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2/cf 2023-07-22 00:07:41,174 DEBUG [StoreOpener-8dff301f9a703583ca77b131db141cc2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2/cf 2023-07-22 00:07:41,174 INFO [StoreOpener-85686a19842c38b6a7930c441a263ffe-1] regionserver.HStore(310): Store=85686a19842c38b6a7930c441a263ffe/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:07:41,174 INFO [StoreOpener-8dff301f9a703583ca77b131db141cc2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8dff301f9a703583ca77b131db141cc2 columnFamilyName cf 2023-07-22 00:07:41,175 INFO [StoreOpener-8dff301f9a703583ca77b131db141cc2-1] regionserver.HStore(310): Store=8dff301f9a703583ca77b131db141cc2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:07:41,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe 2023-07-22 00:07:41,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe 2023-07-22 00:07:41,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2 2023-07-22 00:07:41,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2 2023-07-22 00:07:41,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 85686a19842c38b6a7930c441a263ffe 2023-07-22 00:07:41,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8dff301f9a703583ca77b131db141cc2 2023-07-22 00:07:41,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:07:41,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 85686a19842c38b6a7930c441a263ffe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62223837, jitterRate=-0.07279257476329803}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:07:41,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 85686a19842c38b6a7930c441a263ffe: 2023-07-22 00:07:41,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe., pid=69, masterSystemTime=1689984461165 2023-07-22 00:07:41,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:07:41,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8dff301f9a703583ca77b131db141cc2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63951166, jitterRate=-0.047053366899490356}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:07:41,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8dff301f9a703583ca77b131db141cc2: 2023-07-22 00:07:41,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe. 2023-07-22 00:07:41,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe. 2023-07-22 00:07:41,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2., pid=70, masterSystemTime=1689984461166 2023-07-22 00:07:41,184 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=85686a19842c38b6a7930c441a263ffe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:41,184 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984461184"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984461184"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984461184"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984461184"}]},"ts":"1689984461184"} 2023-07-22 00:07:41,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2. 2023-07-22 00:07:41,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2. 2023-07-22 00:07:41,186 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=8dff301f9a703583ca77b131db141cc2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:41,186 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984461186"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984461186"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984461186"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984461186"}]},"ts":"1689984461186"} 2023-07-22 00:07:41,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-22 00:07:41,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 85686a19842c38b6a7930c441a263ffe, server=jenkins-hbase4.apache.org,43309,1689984379801 in 173 msec 2023-07-22 00:07:41,190 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-22 00:07:41,190 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 8dff301f9a703583ca77b131db141cc2, server=jenkins-hbase4.apache.org,35499,1689984379745 in 173 msec 2023-07-22 00:07:41,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85686a19842c38b6a7930c441a263ffe, ASSIGN in 336 msec 2023-07-22 00:07:41,192 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-22 00:07:41,192 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8dff301f9a703583ca77b131db141cc2, ASSIGN in 337 msec 2023-07-22 00:07:41,192 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:07:41,193 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984461192"}]},"ts":"1689984461192"} 2023-07-22 00:07:41,194 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-22 00:07:41,196 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:07:41,197 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-22 00:07:41,198 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40519] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-22 00:07:41,200 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:41,200 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:41,200 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:41,200 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:07:41,203 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:41,203 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:41,203 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:41,203 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:41,203 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:41,203 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:41,203 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:41,203 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-22 00:07:41,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 405 msec 2023-07-22 00:07:41,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-22 00:07:41,406 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-22 00:07:41,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 85686a19842c38b6a7930c441a263ffe, 8dff301f9a703583ca77b131db141cc2 2023-07-22 00:07:41,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[85686a19842c38b6a7930c441a263ffe, 8dff301f9a703583ca77b131db141cc2], force=true 2023-07-22 00:07:41,444 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[85686a19842c38b6a7930c441a263ffe, 8dff301f9a703583ca77b131db141cc2], force=true 2023-07-22 00:07:41,444 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[85686a19842c38b6a7930c441a263ffe, 8dff301f9a703583ca77b131db141cc2], force=true 2023-07-22 00:07:41,444 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[85686a19842c38b6a7930c441a263ffe, 8dff301f9a703583ca77b131db141cc2], force=true 2023-07-22 00:07:41,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 00:07:41,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85686a19842c38b6a7930c441a263ffe, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8dff301f9a703583ca77b131db141cc2, UNASSIGN}] 2023-07-22 00:07:41,473 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85686a19842c38b6a7930c441a263ffe, UNASSIGN 2023-07-22 00:07:41,473 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8dff301f9a703583ca77b131db141cc2, UNASSIGN 2023-07-22 00:07:41,474 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=85686a19842c38b6a7930c441a263ffe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:41,474 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=8dff301f9a703583ca77b131db141cc2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:41,474 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984461474"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984461474"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984461474"}]},"ts":"1689984461474"} 2023-07-22 00:07:41,474 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984461474"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984461474"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984461474"}]},"ts":"1689984461474"} 2023-07-22 00:07:41,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 85686a19842c38b6a7930c441a263ffe, server=jenkins-hbase4.apache.org,43309,1689984379801}] 2023-07-22 00:07:41,477 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 8dff301f9a703583ca77b131db141cc2, server=jenkins-hbase4.apache.org,35499,1689984379745}] 2023-07-22 00:07:41,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 00:07:41,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 85686a19842c38b6a7930c441a263ffe 2023-07-22 00:07:41,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 85686a19842c38b6a7930c441a263ffe, disabling compactions & flushes 2023-07-22 00:07:41,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe. 2023-07-22 00:07:41,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe. 2023-07-22 00:07:41,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe. after waiting 0 ms 2023-07-22 00:07:41,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe. 2023-07-22 00:07:41,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 85686a19842c38b6a7930c441a263ffe 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-22 00:07:41,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8dff301f9a703583ca77b131db141cc2 2023-07-22 00:07:41,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8dff301f9a703583ca77b131db141cc2, disabling compactions & flushes 2023-07-22 00:07:41,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2. 2023-07-22 00:07:41,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2. 2023-07-22 00:07:41,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2. after waiting 0 ms 2023-07-22 00:07:41,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2. 2023-07-22 00:07:41,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8dff301f9a703583ca77b131db141cc2 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-22 00:07:41,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe/.tmp/cf/5c8a0753bae24382b1bf6131904aa573 2023-07-22 00:07:41,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe/.tmp/cf/5c8a0753bae24382b1bf6131904aa573 as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe/cf/5c8a0753bae24382b1bf6131904aa573 2023-07-22 00:07:41,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2/.tmp/cf/c55872cd67c349e2aae5a73352c7ca86 2023-07-22 00:07:41,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe/cf/5c8a0753bae24382b1bf6131904aa573, entries=1, sequenceid=5, filesize=4.7 K 2023-07-22 00:07:41,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 85686a19842c38b6a7930c441a263ffe in 33ms, sequenceid=5, compaction requested=false 2023-07-22 00:07:41,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-22 00:07:41,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2/.tmp/cf/c55872cd67c349e2aae5a73352c7ca86 as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2/cf/c55872cd67c349e2aae5a73352c7ca86 2023-07-22 00:07:41,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-22 00:07:41,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:07:41,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe. 2023-07-22 00:07:41,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 85686a19842c38b6a7930c441a263ffe: 2023-07-22 00:07:41,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 85686a19842c38b6a7930c441a263ffe 2023-07-22 00:07:41,680 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=85686a19842c38b6a7930c441a263ffe, regionState=CLOSED 2023-07-22 00:07:41,680 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984461680"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984461680"}]},"ts":"1689984461680"} 2023-07-22 00:07:41,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2/cf/c55872cd67c349e2aae5a73352c7ca86, entries=1, sequenceid=5, filesize=4.7 K 2023-07-22 00:07:41,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-22 00:07:41,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 85686a19842c38b6a7930c441a263ffe, server=jenkins-hbase4.apache.org,43309,1689984379801 in 206 msec 2023-07-22 00:07:41,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 8dff301f9a703583ca77b131db141cc2 in 52ms, sequenceid=5, compaction requested=false 2023-07-22 00:07:41,688 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=85686a19842c38b6a7930c441a263ffe, UNASSIGN in 218 msec 2023-07-22 00:07:41,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-22 00:07:41,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:07:41,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2. 2023-07-22 00:07:41,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8dff301f9a703583ca77b131db141cc2: 2023-07-22 00:07:41,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8dff301f9a703583ca77b131db141cc2 2023-07-22 00:07:41,699 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=8dff301f9a703583ca77b131db141cc2, regionState=CLOSED 2023-07-22 00:07:41,700 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689984461699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984461699"}]},"ts":"1689984461699"} 2023-07-22 00:07:41,703 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-22 00:07:41,703 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 8dff301f9a703583ca77b131db141cc2, server=jenkins-hbase4.apache.org,35499,1689984379745 in 224 msec 2023-07-22 00:07:41,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-22 00:07:41,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8dff301f9a703583ca77b131db141cc2, UNASSIGN in 233 msec 2023-07-22 00:07:41,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 00:07:42,036 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0004_000001 (auth:SIMPLE) 2023-07-22 00:07:42,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 00:07:42,206 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-22 00:07:42,208 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460797.85686a19842c38b6a7930c441a263ffe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:42,208 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689984460797.8dff301f9a703583ca77b131db141cc2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:42,208 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-22 00:07:42,307 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f0953d4002d5503d06d19507beb1186, ASSIGN}] 2023-07-22 00:07:42,310 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f0953d4002d5503d06d19507beb1186, ASSIGN 2023-07-22 00:07:42,311 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f0953d4002d5503d06d19507beb1186, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,43309,1689984379801; forceNewPlan=false, retain=false 2023-07-22 00:07:42,462 INFO [jenkins-hbase4:42695] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-22 00:07:42,463 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=9f0953d4002d5503d06d19507beb1186, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:42,464 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689984462463"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984462463"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984462463"}]},"ts":"1689984462463"} 2023-07-22 00:07:42,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 9f0953d4002d5503d06d19507beb1186, server=jenkins-hbase4.apache.org,43309,1689984379801}] 2023-07-22 00:07:42,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 00:07:42,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186. 2023-07-22 00:07:42,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9f0953d4002d5503d06d19507beb1186, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186.', STARTKEY => '', ENDKEY => ''} 2023-07-22 00:07:42,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186. service=AccessControlService 2023-07-22 00:07:42,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:07:42,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 9f0953d4002d5503d06d19507beb1186 2023-07-22 00:07:42,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:07:42,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9f0953d4002d5503d06d19507beb1186 2023-07-22 00:07:42,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9f0953d4002d5503d06d19507beb1186 2023-07-22 00:07:42,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/.regioninfo 2023-07-22 00:07:42,642 INFO [StoreOpener-9f0953d4002d5503d06d19507beb1186-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9f0953d4002d5503d06d19507beb1186 2023-07-22 00:07:42,643 DEBUG [StoreOpener-9f0953d4002d5503d06d19507beb1186-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/cf 2023-07-22 00:07:42,643 DEBUG [StoreOpener-9f0953d4002d5503d06d19507beb1186-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/cf 2023-07-22 00:07:42,644 INFO [StoreOpener-9f0953d4002d5503d06d19507beb1186-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f0953d4002d5503d06d19507beb1186 columnFamilyName cf 2023-07-22 00:07:42,676 DEBUG [StoreOpener-9f0953d4002d5503d06d19507beb1186-1] regionserver.HStore(539): loaded hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/cf/5c8a0753bae24382b1bf6131904aa573.85686a19842c38b6a7930c441a263ffe->hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe/cf/5c8a0753bae24382b1bf6131904aa573-top 2023-07-22 00:07:42,683 DEBUG [StoreOpener-9f0953d4002d5503d06d19507beb1186-1] regionserver.HStore(539): loaded hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/cf/c55872cd67c349e2aae5a73352c7ca86.8dff301f9a703583ca77b131db141cc2->hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2/cf/c55872cd67c349e2aae5a73352c7ca86-top 2023-07-22 00:07:42,684 INFO [StoreOpener-9f0953d4002d5503d06d19507beb1186-1] regionserver.HStore(310): Store=9f0953d4002d5503d06d19507beb1186/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:07:42,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186 2023-07-22 00:07:42,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186 2023-07-22 00:07:42,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9f0953d4002d5503d06d19507beb1186 2023-07-22 00:07:42,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9f0953d4002d5503d06d19507beb1186; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65575053, jitterRate=-0.022855564951896667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:07:42,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9f0953d4002d5503d06d19507beb1186: 2023-07-22 00:07:42,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186., pid=77, masterSystemTime=1689984462618 2023-07-22 00:07:42,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186.,because compaction is disabled. 2023-07-22 00:07:42,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186. 2023-07-22 00:07:42,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186. 2023-07-22 00:07:42,696 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=9f0953d4002d5503d06d19507beb1186, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:42,697 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689984462696"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984462696"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984462696"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984462696"}]},"ts":"1689984462696"} 2023-07-22 00:07:42,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-22 00:07:42,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 9f0953d4002d5503d06d19507beb1186, server=jenkins-hbase4.apache.org,43309,1689984379801 in 240 msec 2023-07-22 00:07:42,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-22 00:07:42,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f0953d4002d5503d06d19507beb1186, ASSIGN in 401 msec 2023-07-22 00:07:42,716 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[85686a19842c38b6a7930c441a263ffe, 8dff301f9a703583ca77b131db141cc2], force=true in 1.2740 sec 2023-07-22 00:07:43,368 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 00:07:43,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-22 00:07:43,555 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-22 00:07:43,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 00:07:43,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984463556 (current time:1689984463556). 2023-07-22 00:07:43,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:07:43,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x2eb71d92 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:43,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59b83a12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:43,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:43,572 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:43,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2eb71d92 to 127.0.0.1:58666 2023-07-22 00:07:43,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:43,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x7c4f3299 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:07:43,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a82eb0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:07:43,587 DEBUG [hconnection-0x72f234e7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:07:43,590 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:07:43,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c4f3299 to 127.0.0.1:58666 2023-07-22 00:07:43,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:07:43,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-22 00:07:43,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:07:43,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 00:07:43,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 00:07:43,605 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 00:07:43,606 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689985063606 2023-07-22 00:07:43,606 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-22 00:07:43,611 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:07:43,611 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:07:43,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 00:07:43,614 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-22 00:07:43,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 15 msec 2023-07-22 00:07:43,617 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 00:07:43,617 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689985063617 2023-07-22 00:07:43,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,635 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-22 00:07:43,635 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:43,636 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-22 00:07:43,636 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-22 00:07:43,703 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,703 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,706 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:43,706 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:43,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:43,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:43,706 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,706 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:43,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:43,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:43,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:43,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:43,706 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,706 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:07:43,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 00:07:43,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,708 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 00:07:43,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 00:07:43,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,709 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 00:07:43,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-22 00:07:43,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,711 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-22 00:07:43,711 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:43,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-22 00:07:43,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:43,713 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:07:43,714 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,715 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 00:07:43,715 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:43,720 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 00:07:43,720 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 00:07:43,720 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 00:07:43,721 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,721 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 00:07:43,721 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:43,721 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,722 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 00:07:43,723 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 00:07:43,723 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 00:07:43,723 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-22 00:07:43,723 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:07:43,723 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,724 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-22 00:07:43,724 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-22 00:07:43,723 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,724 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-22 00:07:43,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,724 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,724 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:43,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:43,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:43,725 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:43,726 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,726 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:43,728 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:43,728 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,728 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:07:43,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:43,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:43,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:43,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-22 00:07:43,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e96a5dd[Count = 0] remaining members to acquire global barrier 2023-07-22 00:07:43,729 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-22 00:07:43,730 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,731 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,731 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,731 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,731 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 00:07:43,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,731 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:07:43,731 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 00:07:43,731 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 00:07:43,731 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35499,1689984379745' in zk 2023-07-22 00:07:43,731 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-22 00:07:43,731 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,731 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:07:43,731 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 00:07:43,731 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186. 2023-07-22 00:07:43,731 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:07:43,732 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186. started... 2023-07-22 00:07:43,732 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40519,1689984379684' in zk 2023-07-22 00:07:43,733 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9f0953d4002d5503d06d19507beb1186: 2023-07-22 00:07:43,733 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,733 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:07:43,733 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/cf/5c8a0753bae24382b1bf6131904aa573.85686a19842c38b6a7930c441a263ffe->hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe/cf/5c8a0753bae24382b1bf6131904aa573-top, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/cf/c55872cd67c349e2aae5a73352c7ca86.8dff301f9a703583ca77b131db141cc2->hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2/cf/c55872cd67c349e2aae5a73352c7ca86-top] hfiles 2023-07-22 00:07:43,733 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/cf/5c8a0753bae24382b1bf6131904aa573.85686a19842c38b6a7930c441a263ffe for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,734 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 00:07:43,734 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/cf/c55872cd67c349e2aae5a73352c7ca86.8dff301f9a703583ca77b131db141cc2 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,734 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:43,734 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 00:07:43,736 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 00:07:43,736 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:43,736 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 00:07:43,755 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186. completed. 2023-07-22 00:07:43,755 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186. 2023-07-22 00:07:43,755 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:07:43,755 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:07:43,755 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,755 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-22 00:07:43,755 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43309,1689984379801' in zk 2023-07-22 00:07:43,760 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-22 00:07:43,760 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,760 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:43,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:43,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:43,760 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-22 00:07:43,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:43,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:43,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:43,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:43,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:43,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:43,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:43,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,43309,1689984379801': 2023-07-22 00:07:43,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-22 00:07:43,764 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-22 00:07:43,765 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:07:43,765 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:07:43,765 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,765 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:07:43,767 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,767 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:43,767 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:07:43,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:07:43,767 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,767 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:43,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:07:43,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:43,768 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:43,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:43,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:43,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,768 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:43,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:07:43,769 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:43,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:43,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:43,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:07:43,771 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:43,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,772 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:43,772 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:43,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:43,774 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,775 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:43,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,776 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:43,776 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:43,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:43,776 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,776 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:43,776 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:43,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-22 00:07:43,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:43,776 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:43,777 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,777 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,777 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:07:43,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:43,777 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:07:43,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:43,778 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:07:43,778 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:07:43,777 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:07:43,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:07:43,777 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,778 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:07:43,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:07:43,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:07:43,779 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:07:43,779 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,779 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,779 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:43,913 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:43,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-22 00:07:43,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:43,914 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 00:07:44,215 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:44,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-22 00:07:44,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:07:44,216 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-22 00:07:44,288 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-22 00:07:44,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:44,288 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:44,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689984463606Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689984463779 (+173 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689984463779Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689984463788 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689984463807 (+19 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689984464288 (+481 ms) 2023-07-22 00:07:44,292 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-22 00:07:44,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 681 msec 2023-07-22 00:07:44,717 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:07:44,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-22 00:07:44,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:07:44,718 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984464718 2023-07-22 00:07:44,718 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34573, tgtDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984464718, rawTgtDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984464718, srcFsUri=hdfs://localhost:34573, srcDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:07:44,753 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34573, inputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:07:44,753 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-848221799_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984464718, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984464718/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:44,753 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34573, inputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d, snapshotDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-22 00:07:44,763 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984464718/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:07:44,795 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,795 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,796 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,796 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,796 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,797 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,797 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,875 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/hadoop-7780229991346613332.jar 2023-07-22 00:07:44,876 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,876 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,877 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,877 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,878 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,878 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 00:07:44,878 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 00:07:44,879 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 00:07:44,879 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 00:07:44,880 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 00:07:44,881 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 00:07:44,881 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 00:07:44,882 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 00:07:44,882 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 00:07:44,883 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 00:07:44,883 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 00:07:44,884 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:44,884 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:44,884 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:44,885 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:44,885 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:07:44,886 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:44,886 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:07:45,776 WARN [Listener at jenkins-hbase4.apache.org/40445] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 00:07:45,780 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-22 00:07:45,783 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-22 00:07:45,951 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:07:45,951 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:07:46,043 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0005_000001 (auth:SIMPLE) 2023-07-22 00:07:52,239 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0005_000001 (auth:SIMPLE) 2023-07-22 00:07:54,551 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0005_000001 (auth:SIMPLE) 2023-07-22 00:07:59,755 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0005_000001 (auth:SIMPLE) 2023-07-22 00:08:01,171 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 00:08:01,180 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 00:08:01,194 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,194 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 00:08:01,195 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 00:08:01,195 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1699920953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,195 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-22 00:08:01,195 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-22 00:08:01,195 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1699920953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984464718/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984464718/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,196 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984464718/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-22 00:08:01,196 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984464718/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-22 00:08:01,206 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 00:08:01,213 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984481213"}]},"ts":"1689984481213"} 2023-07-22 00:08:01,215 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-22 00:08:01,217 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-22 00:08:01,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f0953d4002d5503d06d19507beb1186, UNASSIGN}] 2023-07-22 00:08:01,218 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f0953d4002d5503d06d19507beb1186, UNASSIGN 2023-07-22 00:08:01,219 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9f0953d4002d5503d06d19507beb1186, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:01,219 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689984481219"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984481219"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984481219"}]},"ts":"1689984481219"} 2023-07-22 00:08:01,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 9f0953d4002d5503d06d19507beb1186, server=jenkins-hbase4.apache.org,43309,1689984379801}] 2023-07-22 00:08:01,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 00:08:01,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9f0953d4002d5503d06d19507beb1186 2023-07-22 00:08:01,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9f0953d4002d5503d06d19507beb1186, disabling compactions & flushes 2023-07-22 00:08:01,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186. 2023-07-22 00:08:01,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186. 2023-07-22 00:08:01,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186. after waiting 0 ms 2023-07-22 00:08:01,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186. 2023-07-22 00:08:01,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-22 00:08:01,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:08:01,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186. 2023-07-22 00:08:01,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9f0953d4002d5503d06d19507beb1186: 2023-07-22 00:08:01,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9f0953d4002d5503d06d19507beb1186 2023-07-22 00:08:01,386 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9f0953d4002d5503d06d19507beb1186, regionState=CLOSED 2023-07-22 00:08:01,387 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689984481386"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984481386"}]},"ts":"1689984481386"} 2023-07-22 00:08:01,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-22 00:08:01,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 9f0953d4002d5503d06d19507beb1186, server=jenkins-hbase4.apache.org,43309,1689984379801 in 167 msec 2023-07-22 00:08:01,391 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-22 00:08:01,391 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9f0953d4002d5503d06d19507beb1186, UNASSIGN in 171 msec 2023-07-22 00:08:01,392 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984481391"}]},"ts":"1689984481391"} 2023-07-22 00:08:01,393 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-22 00:08:01,395 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-22 00:08:01,397 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 188 msec 2023-07-22 00:08:01,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-22 00:08:01,514 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-22 00:08:01,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,518 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,519 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,520 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40519] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,523 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,523 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-22 00:08:01,524 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,524 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-22 00:08:01,525 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186 2023-07-22 00:08:01,525 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe 2023-07-22 00:08:01,525 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2 2023-07-22 00:08:01,525 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,525 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:01,525 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-22 00:08:01,525 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,526 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,525 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:01,526 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:01,526 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:01,526 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 00:08:01,527 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-22 00:08:01,527 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 00:08:01,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-22 00:08:01,527 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:01,527 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/cf, FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/recovered.edits] 2023-07-22 00:08:01,528 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:01,528 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:01,528 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2/cf, FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2/recovered.edits] 2023-07-22 00:08:01,528 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:01,532 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe/cf, FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe/recovered.edits] 2023-07-22 00:08:01,534 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2/cf/c55872cd67c349e2aae5a73352c7ca86 to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2/cf/c55872cd67c349e2aae5a73352c7ca86 2023-07-22 00:08:01,535 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/cf/5c8a0753bae24382b1bf6131904aa573.85686a19842c38b6a7930c441a263ffe to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/cf/5c8a0753bae24382b1bf6131904aa573.85686a19842c38b6a7930c441a263ffe 2023-07-22 00:08:01,538 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe/cf/5c8a0753bae24382b1bf6131904aa573 to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe/cf/5c8a0753bae24382b1bf6131904aa573 2023-07-22 00:08:01,539 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/cf/c55872cd67c349e2aae5a73352c7ca86.8dff301f9a703583ca77b131db141cc2 to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/cf/c55872cd67c349e2aae5a73352c7ca86.8dff301f9a703583ca77b131db141cc2 2023-07-22 00:08:01,540 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2/recovered.edits/8.seqid to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2/recovered.edits/8.seqid 2023-07-22 00:08:01,541 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8dff301f9a703583ca77b131db141cc2 2023-07-22 00:08:01,544 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe/recovered.edits/8.seqid to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe/recovered.edits/8.seqid 2023-07-22 00:08:01,545 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/85686a19842c38b6a7930c441a263ffe 2023-07-22 00:08:01,545 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/recovered.edits/12.seqid to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186/recovered.edits/12.seqid 2023-07-22 00:08:01,545 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9f0953d4002d5503d06d19507beb1186 2023-07-22 00:08:01,545 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-22 00:08:01,548 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,556 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-22 00:08:01,560 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-22 00:08:01,561 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,561 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-22 00:08:01,562 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984481561"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:01,564 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-22 00:08:01,564 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9f0953d4002d5503d06d19507beb1186, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689984460798.9f0953d4002d5503d06d19507beb1186.', STARTKEY => '', ENDKEY => ''}] 2023-07-22 00:08:01,564 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-22 00:08:01,564 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689984481564"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:01,566 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-22 00:08:01,568 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:01,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 54 msec 2023-07-22 00:08:01,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-22 00:08:01,628 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-22 00:08:01,629 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 00:08:01,634 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984481634"}]},"ts":"1689984481634"} 2023-07-22 00:08:01,635 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-22 00:08:01,637 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-22 00:08:01,638 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c8c04147180c7e9e403d9d5086be363, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fbc1607751b85e3b4903d0be18981649, UNASSIGN}] 2023-07-22 00:08:01,640 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c8c04147180c7e9e403d9d5086be363, UNASSIGN 2023-07-22 00:08:01,640 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fbc1607751b85e3b4903d0be18981649, UNASSIGN 2023-07-22 00:08:01,641 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=0c8c04147180c7e9e403d9d5086be363, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:01,641 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=fbc1607751b85e3b4903d0be18981649, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:01,641 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984481641"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984481641"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984481641"}]},"ts":"1689984481641"} 2023-07-22 00:08:01,641 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984481641"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984481641"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984481641"}]},"ts":"1689984481641"} 2023-07-22 00:08:01,642 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 0c8c04147180c7e9e403d9d5086be363, server=jenkins-hbase4.apache.org,40519,1689984379684}] 2023-07-22 00:08:01,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure fbc1607751b85e3b4903d0be18981649, server=jenkins-hbase4.apache.org,35499,1689984379745}] 2023-07-22 00:08:01,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 00:08:01,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0c8c04147180c7e9e403d9d5086be363 2023-07-22 00:08:01,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0c8c04147180c7e9e403d9d5086be363, disabling compactions & flushes 2023-07-22 00:08:01,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. 2023-07-22 00:08:01,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. 2023-07-22 00:08:01,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. after waiting 0 ms 2023-07-22 00:08:01,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. 2023-07-22 00:08:01,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fbc1607751b85e3b4903d0be18981649 2023-07-22 00:08:01,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fbc1607751b85e3b4903d0be18981649, disabling compactions & flushes 2023-07-22 00:08:01,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. 2023-07-22 00:08:01,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. 2023-07-22 00:08:01,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. after waiting 0 ms 2023-07-22 00:08:01,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. 2023-07-22 00:08:01,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:08:01,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:08:01,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:08:01,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649. 2023-07-22 00:08:01,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fbc1607751b85e3b4903d0be18981649: 2023-07-22 00:08:01,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:08:01,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363. 2023-07-22 00:08:01,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0c8c04147180c7e9e403d9d5086be363: 2023-07-22 00:08:01,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fbc1607751b85e3b4903d0be18981649 2023-07-22 00:08:01,848 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=fbc1607751b85e3b4903d0be18981649, regionState=CLOSED 2023-07-22 00:08:01,848 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984481848"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984481848"}]},"ts":"1689984481848"} 2023-07-22 00:08:01,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0c8c04147180c7e9e403d9d5086be363 2023-07-22 00:08:01,850 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=0c8c04147180c7e9e403d9d5086be363, regionState=CLOSED 2023-07-22 00:08:01,850 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689984481850"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984481850"}]},"ts":"1689984481850"} 2023-07-22 00:08:01,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-22 00:08:01,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure fbc1607751b85e3b4903d0be18981649, server=jenkins-hbase4.apache.org,35499,1689984379745 in 207 msec 2023-07-22 00:08:01,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=fbc1607751b85e3b4903d0be18981649, UNASSIGN in 214 msec 2023-07-22 00:08:01,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-22 00:08:01,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 0c8c04147180c7e9e403d9d5086be363, server=jenkins-hbase4.apache.org,40519,1689984379684 in 210 msec 2023-07-22 00:08:01,856 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-22 00:08:01,856 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c8c04147180c7e9e403d9d5086be363, UNASSIGN in 216 msec 2023-07-22 00:08:01,857 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984481857"}]},"ts":"1689984481857"} 2023-07-22 00:08:01,858 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-22 00:08:01,860 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-22 00:08:01,862 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 232 msec 2023-07-22 00:08:01,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-22 00:08:01,937 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-22 00:08:01,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,941 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,943 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,944 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40519] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,948 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,948 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,948 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,948 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,948 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 00:08:01,948 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 00:08:01,949 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-22 00:08:01,952 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363 2023-07-22 00:08:01,952 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649 2023-07-22 00:08:01,955 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363/cf, FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363/recovered.edits] 2023-07-22 00:08:01,955 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,955 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:01,955 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,955 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:01,956 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,956 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:01,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-22 00:08:01,958 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649/cf, FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649/recovered.edits] 2023-07-22 00:08:01,960 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:01,960 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-22 00:08:01,960 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-22 00:08:01,965 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363/cf/6d3e63dd6e8d4c42b14c472b58731649 to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363/cf/6d3e63dd6e8d4c42b14c472b58731649 2023-07-22 00:08:01,966 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649/cf/143c3109e42c4fb9b456490a19ee0ab4 to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649/cf/143c3109e42c4fb9b456490a19ee0ab4 2023-07-22 00:08:01,968 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363/recovered.edits/9.seqid to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363/recovered.edits/9.seqid 2023-07-22 00:08:01,969 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c8c04147180c7e9e403d9d5086be363 2023-07-22 00:08:01,970 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649/recovered.edits/9.seqid to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649/recovered.edits/9.seqid 2023-07-22 00:08:01,970 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/fbc1607751b85e3b4903d0be18981649 2023-07-22 00:08:01,970 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-22 00:08:01,973 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,975 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-22 00:08:01,977 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-22 00:08:01,978 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,978 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-22 00:08:01,978 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984481978"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:01,978 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984481978"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:01,980 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 00:08:01,980 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0c8c04147180c7e9e403d9d5086be363, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689984458132.0c8c04147180c7e9e403d9d5086be363.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fbc1607751b85e3b4903d0be18981649, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689984458132.fbc1607751b85e3b4903d0be18981649.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 00:08:01,980 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-22 00:08:01,980 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689984481980"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:01,982 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-22 00:08:01,985 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:01,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 47 msec 2023-07-22 00:08:02,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-22 00:08:02,059 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-22 00:08:02,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-22 00:08:02,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:02,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-22 00:08:02,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-22 00:08:02,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-22 00:08:02,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-22 00:08:02,105 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 748) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1699920953_17 at /127.0.0.1:42240 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1061191814_1 at /127.0.0.1:48408 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:33747 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1699920953_17 at /127.0.0.1:41446 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:40445 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1699920953_17 at /127.0.0.1:36706 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1061191814_1 at /127.0.0.1:36074 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3829 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 894) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=644 (was 480) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=6949 (was 7623) 2023-07-22 00:08:02,105 WARN [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-22 00:08:02,129 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=644, ProcessCount=180, AvailableMemoryMB=6947 2023-07-22 00:08:02,129 WARN [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-22 00:08:02,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 00:08:02,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 00:08:02,134 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:08:02,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-22 00:08:02,135 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:08:02,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 00:08:02,137 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b 2023-07-22 00:08:02,137 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c 2023-07-22 00:08:02,137 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b empty. 2023-07-22 00:08:02,138 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c empty. 2023-07-22 00:08:02,138 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b 2023-07-22 00:08:02,138 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c 2023-07-22 00:08:02,138 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-22 00:08:02,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 00:08:02,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 00:08:02,561 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-22 00:08:02,562 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 92a0e8ea7b06a0a552c088efd7fb9a7b, NAME => 'testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp 2023-07-22 00:08:02,562 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => cc1435506ff6dc097eaa584ee48aa83c, NAME => 'testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp 2023-07-22 00:08:02,579 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:08:02,579 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 92a0e8ea7b06a0a552c088efd7fb9a7b, disabling compactions & flushes 2023-07-22 00:08:02,579 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. 2023-07-22 00:08:02,579 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. 2023-07-22 00:08:02,579 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. after waiting 0 ms 2023-07-22 00:08:02,579 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. 2023-07-22 00:08:02,579 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. 2023-07-22 00:08:02,579 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 92a0e8ea7b06a0a552c088efd7fb9a7b: 2023-07-22 00:08:02,581 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:08:02,581 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing cc1435506ff6dc097eaa584ee48aa83c, disabling compactions & flushes 2023-07-22 00:08:02,581 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. 2023-07-22 00:08:02,581 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. 2023-07-22 00:08:02,581 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. after waiting 0 ms 2023-07-22 00:08:02,581 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. 2023-07-22 00:08:02,581 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. 2023-07-22 00:08:02,581 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for cc1435506ff6dc097eaa584ee48aa83c: 2023-07-22 00:08:02,585 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:08:02,586 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984482586"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984482586"}]},"ts":"1689984482586"} 2023-07-22 00:08:02,586 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984482586"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984482586"}]},"ts":"1689984482586"} 2023-07-22 00:08:02,588 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 00:08:02,589 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:08:02,589 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984482589"}]},"ts":"1689984482589"} 2023-07-22 00:08:02,590 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-22 00:08:02,594 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:08:02,595 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:08:02,595 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:08:02,595 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:08:02,595 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:08:02,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92a0e8ea7b06a0a552c088efd7fb9a7b, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc1435506ff6dc097eaa584ee48aa83c, ASSIGN}] 2023-07-22 00:08:02,598 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc1435506ff6dc097eaa584ee48aa83c, ASSIGN 2023-07-22 00:08:02,598 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92a0e8ea7b06a0a552c088efd7fb9a7b, ASSIGN 2023-07-22 00:08:02,599 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc1435506ff6dc097eaa584ee48aa83c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43309,1689984379801; forceNewPlan=false, retain=false 2023-07-22 00:08:02,599 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92a0e8ea7b06a0a552c088efd7fb9a7b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40519,1689984379684; forceNewPlan=false, retain=false 2023-07-22 00:08:02,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 00:08:02,749 INFO [jenkins-hbase4:42695] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 00:08:02,752 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=92a0e8ea7b06a0a552c088efd7fb9a7b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:02,752 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=cc1435506ff6dc097eaa584ee48aa83c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:02,753 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984482752"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984482752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984482752"}]},"ts":"1689984482752"} 2023-07-22 00:08:02,753 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984482752"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984482752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984482752"}]},"ts":"1689984482752"} 2023-07-22 00:08:02,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 92a0e8ea7b06a0a552c088efd7fb9a7b, server=jenkins-hbase4.apache.org,40519,1689984379684}] 2023-07-22 00:08:02,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure cc1435506ff6dc097eaa584ee48aa83c, server=jenkins-hbase4.apache.org,43309,1689984379801}] 2023-07-22 00:08:02,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. 2023-07-22 00:08:02,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 92a0e8ea7b06a0a552c088efd7fb9a7b, NAME => 'testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 00:08:02,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. 2023-07-22 00:08:02,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc1435506ff6dc097eaa584ee48aa83c, NAME => 'testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 00:08:02,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. service=AccessControlService 2023-07-22 00:08:02,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. service=AccessControlService 2023-07-22 00:08:02,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:08:02,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:08:02,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 92a0e8ea7b06a0a552c088efd7fb9a7b 2023-07-22 00:08:02,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState cc1435506ff6dc097eaa584ee48aa83c 2023-07-22 00:08:02,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:08:02,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cc1435506ff6dc097eaa584ee48aa83c 2023-07-22 00:08:02,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cc1435506ff6dc097eaa584ee48aa83c 2023-07-22 00:08:02,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:08:02,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 92a0e8ea7b06a0a552c088efd7fb9a7b 2023-07-22 00:08:02,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 92a0e8ea7b06a0a552c088efd7fb9a7b 2023-07-22 00:08:02,915 INFO [StoreOpener-cc1435506ff6dc097eaa584ee48aa83c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cc1435506ff6dc097eaa584ee48aa83c 2023-07-22 00:08:02,915 INFO [StoreOpener-92a0e8ea7b06a0a552c088efd7fb9a7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 92a0e8ea7b06a0a552c088efd7fb9a7b 2023-07-22 00:08:02,916 DEBUG [StoreOpener-92a0e8ea7b06a0a552c088efd7fb9a7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b/cf 2023-07-22 00:08:02,916 DEBUG [StoreOpener-92a0e8ea7b06a0a552c088efd7fb9a7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b/cf 2023-07-22 00:08:02,916 DEBUG [StoreOpener-cc1435506ff6dc097eaa584ee48aa83c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c/cf 2023-07-22 00:08:02,917 DEBUG [StoreOpener-cc1435506ff6dc097eaa584ee48aa83c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c/cf 2023-07-22 00:08:02,917 INFO [StoreOpener-92a0e8ea7b06a0a552c088efd7fb9a7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92a0e8ea7b06a0a552c088efd7fb9a7b columnFamilyName cf 2023-07-22 00:08:02,917 INFO [StoreOpener-cc1435506ff6dc097eaa584ee48aa83c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc1435506ff6dc097eaa584ee48aa83c columnFamilyName cf 2023-07-22 00:08:02,918 INFO [StoreOpener-92a0e8ea7b06a0a552c088efd7fb9a7b-1] regionserver.HStore(310): Store=92a0e8ea7b06a0a552c088efd7fb9a7b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:08:02,918 INFO [StoreOpener-cc1435506ff6dc097eaa584ee48aa83c-1] regionserver.HStore(310): Store=cc1435506ff6dc097eaa584ee48aa83c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:08:02,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c 2023-07-22 00:08:02,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b 2023-07-22 00:08:02,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c 2023-07-22 00:08:02,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b 2023-07-22 00:08:02,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 92a0e8ea7b06a0a552c088efd7fb9a7b 2023-07-22 00:08:02,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cc1435506ff6dc097eaa584ee48aa83c 2023-07-22 00:08:02,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:08:02,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:08:02,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cc1435506ff6dc097eaa584ee48aa83c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63156569, jitterRate=-0.05889378488063812}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:08:02,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cc1435506ff6dc097eaa584ee48aa83c: 2023-07-22 00:08:02,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 92a0e8ea7b06a0a552c088efd7fb9a7b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73385073, jitterRate=0.0935228019952774}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:08:02,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 92a0e8ea7b06a0a552c088efd7fb9a7b: 2023-07-22 00:08:02,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c., pid=94, masterSystemTime=1689984482907 2023-07-22 00:08:02,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. 2023-07-22 00:08:02,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b., pid=93, masterSystemTime=1689984482907 2023-07-22 00:08:02,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. 2023-07-22 00:08:02,927 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=cc1435506ff6dc097eaa584ee48aa83c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:02,927 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984482927"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984482927"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984482927"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984482927"}]},"ts":"1689984482927"} 2023-07-22 00:08:02,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. 2023-07-22 00:08:02,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. 2023-07-22 00:08:02,928 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=92a0e8ea7b06a0a552c088efd7fb9a7b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:02,928 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984482928"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984482928"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984482928"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984482928"}]},"ts":"1689984482928"} 2023-07-22 00:08:02,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-22 00:08:02,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure cc1435506ff6dc097eaa584ee48aa83c, server=jenkins-hbase4.apache.org,43309,1689984379801 in 174 msec 2023-07-22 00:08:02,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-22 00:08:02,932 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc1435506ff6dc097eaa584ee48aa83c, ASSIGN in 335 msec 2023-07-22 00:08:02,932 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 92a0e8ea7b06a0a552c088efd7fb9a7b, server=jenkins-hbase4.apache.org,40519,1689984379684 in 176 msec 2023-07-22 00:08:02,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-22 00:08:02,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92a0e8ea7b06a0a552c088efd7fb9a7b, ASSIGN in 337 msec 2023-07-22 00:08:02,934 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:08:02,934 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984482934"}]},"ts":"1689984482934"} 2023-07-22 00:08:02,935 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-22 00:08:02,938 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:08:02,938 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-22 00:08:02,940 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40519] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 00:08:02,942 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:02,942 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:02,943 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:02,943 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:02,946 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 813 msec 2023-07-22 00:08:02,946 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:02,946 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:02,946 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:02,946 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:03,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-22 00:08:03,241 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-22 00:08:03,241 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-22 00:08:03,242 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:08:03,245 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-22 00:08:03,245 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:08:03,245 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-22 00:08:03,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:08:03,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984483248 (current time:1689984483248). 2023-07-22 00:08:03,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:08:03,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x2e170401 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:08:03,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@371bb891, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:08:03,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:03,264 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36498, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:03,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e170401 to 127.0.0.1:58666 2023-07-22 00:08:03,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:08:03,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x0f61d7ee to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:08:03,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1940ed0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:08:03,286 DEBUG [hconnection-0x73f50186-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:03,287 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36504, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:03,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f61d7ee to 127.0.0.1:58666 2023-07-22 00:08:03,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:08:03,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 00:08:03,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:08:03,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:08:03,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:08:03,299 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:08:03,307 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689985083307 2023-07-22 00:08:03,307 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-22 00:08:03,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:08:03,309 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:08:03,309 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:08:03,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 00:08:03,311 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:08:03,312 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 14 msec 2023-07-22 00:08:03,315 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 00:08:03,315 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689985083315 2023-07-22 00:08:03,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,332 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-22 00:08:03,332 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:03,333 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-22 00:08:03,333 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-22 00:08:03,396 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,398 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,404 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:03,404 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:03,404 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,404 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:03,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:03,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:03,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:03,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:03,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:03,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:03,405 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,405 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,405 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,405 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:08:03,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 00:08:03,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,406 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 00:08:03,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 00:08:03,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,407 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 00:08:03,407 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,407 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 00:08:03,407 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:03,407 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-22 00:08:03,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,409 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 00:08:03,409 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 00:08:03,409 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:03,409 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 00:08:03,409 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 00:08:03,409 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 00:08:03,409 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:03,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,410 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 00:08:03,412 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:03,411 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 00:08:03,413 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 00:08:03,413 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 00:08:03,413 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 00:08:03,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:08:03,413 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 00:08:03,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:08:03,413 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 00:08:03,414 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:08:03,414 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,414 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:03,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:03,417 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,417 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,418 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:03,418 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,418 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:03,418 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,418 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:03,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:03,418 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,418 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:03,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:03,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:03,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 00:08:03,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79d342f7[Count = 1] remaining members to acquire global barrier 2023-07-22 00:08:03,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:03,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:03,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:03,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:03,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:03,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:03,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 00:08:03,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79d342f7[Count = 0] remaining members to acquire global barrier 2023-07-22 00:08:03,423 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 00:08:03,423 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,425 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,425 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,425 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,426 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:08:03,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,426 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:08:03,426 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,426 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:08:03,426 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 00:08:03,426 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35499,1689984379745' in zk 2023-07-22 00:08:03,426 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,426 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:08:03,426 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:08:03,426 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:08:03,427 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. 2023-07-22 00:08:03,427 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. started... 2023-07-22 00:08:03,428 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 00:08:03,428 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:03,428 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 00:08:03,438 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:08:03,438 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc1435506ff6dc097eaa584ee48aa83c: 2023-07-22 00:08:03,438 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. 2023-07-22 00:08:03,438 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:08:03,438 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,438 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. started... 2023-07-22 00:08:03,439 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:08:03,439 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:08:03,440 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 92a0e8ea7b06a0a552c088efd7fb9a7b: 2023-07-22 00:08:03,440 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,440 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:08:03,440 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:08:03,462 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. completed. 2023-07-22 00:08:03,463 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. completed. 2023-07-22 00:08:03,463 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. 2023-07-22 00:08:03,463 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. 2023-07-22 00:08:03,463 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:08:03,463 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:08:03,463 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,463 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:08:03,463 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 00:08:03,463 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:08:03,463 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,463 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 00:08:03,463 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40519,1689984379684' in zk 2023-07-22 00:08:03,463 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43309,1689984379801' in zk 2023-07-22 00:08:03,465 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 00:08:03,465 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 00:08:03,465 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:03,465 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,465 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 00:08:03,465 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:03,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:03,467 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:03,467 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 00:08:03,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:03,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:03,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:03,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:03,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:03,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43309,1689984379801': 2023-07-22 00:08:03,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 00:08:03,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:03,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:03,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:03,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:03,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:03,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:03,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40519,1689984379684': 2023-07-22 00:08:03,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 00:08:03,477 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-22 00:08:03,477 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:08:03,477 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:08:03,477 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,477 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:08:03,479 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,479 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,479 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,479 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:03,479 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,479 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:03,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,480 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:03,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:03,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:03,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:03,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:03,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:03,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:03,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:03,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:03,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:03,480 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,481 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:03,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:03,481 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:03,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:03,483 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:03,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,483 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:03,484 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,487 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:03,487 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:03,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:03,487 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:03,488 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,488 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:03,488 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:03,488 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,489 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:03,489 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,489 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:03,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:03,488 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:03,489 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:03,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:03,489 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,490 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,490 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,490 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:03,490 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,490 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:03,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:03,490 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:03,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:03,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:03,490 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:03,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:03,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:03,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,588 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-22 00:08:03,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,588 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689984483307Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689984483489 (+182 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689984483489Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689984483494 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689984483517 (+23 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689984483588 (+71 ms) 2023-07-22 00:08:03,592 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 00:08:03,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 283 msec 2023-07-22 00:08:03,614 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:03,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:08:03,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:08:03,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40519] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:08:03,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43309] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:08:03,632 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-22 00:08:03,632 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. 2023-07-22 00:08:03,632 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:08:03,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:08:03,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984483650 (current time:1689984483650). 2023-07-22 00:08:03,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:08:03,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x3f7aba67 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:08:03,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6458753f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:08:03,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:03,670 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:03,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f7aba67 to 127.0.0.1:58666 2023-07-22 00:08:03,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:08:03,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x1e97f2ba to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:08:03,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74d4da8d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:08:03,779 DEBUG [hconnection-0x5302b8a5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:03,783 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:03,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e97f2ba to 127.0.0.1:58666 2023-07-22 00:08:03,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:08:03,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-22 00:08:03,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:08:03,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:08:03,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:08:03,795 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:08:03,796 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689985083796 2023-07-22 00:08:03,796 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-22 00:08:03,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-22 00:08:03,797 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:08:03,798 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:08:03,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 00:08:03,799 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-22 00:08:03,801 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-22 00:08:03,801 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 00:08:03,802 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689985083802 2023-07-22 00:08:03,827 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,827 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-22 00:08:03,827 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:03,829 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-22 00:08:03,829 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-22 00:08:03,830 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,830 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,832 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:03,832 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:03,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:03,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:03,832 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:03,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:03,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:03,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:03,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:03,832 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,833 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,833 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,833 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,833 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:08:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 00:08:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 00:08:03,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-22 00:08:03,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,834 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 00:08:03,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,834 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 00:08:03,834 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-22 00:08:03,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,843 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,843 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 00:08:03,843 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 00:08:03,843 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:03,843 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:03,848 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 00:08:03,848 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 00:08:03,848 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 00:08:03,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,848 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 00:08:03,848 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-22 00:08:03,848 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:03,848 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 00:08:03,852 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 00:08:03,852 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-22 00:08:03,853 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-22 00:08:03,853 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-22 00:08:03,854 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,854 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:03,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:03,856 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,856 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:03,856 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,856 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,856 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:03,856 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:03,856 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:03,857 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,857 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:03,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:03,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:03,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 00:08:03,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30e07b01[Count = 1] remaining members to acquire global barrier 2023-07-22 00:08:03,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:03,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:03,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:03,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:03,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:03,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:03,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-22 00:08:03,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30e07b01[Count = 0] remaining members to acquire global barrier 2023-07-22 00:08:03,862 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-22 00:08:03,863 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,868 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,868 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,868 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,868 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:08:03,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,868 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:08:03,868 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,868 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:08:03,869 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:08:03,869 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. 2023-07-22 00:08:03,868 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. 2023-07-22 00:08:03,868 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:08:03,869 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:08:03,869 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,869 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:08:03,869 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. started... 2023-07-22 00:08:03,869 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. started... 2023-07-22 00:08:03,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,869 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-22 00:08:03,869 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 00:08:03,869 INFO [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cc1435506ff6dc097eaa584ee48aa83c 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-22 00:08:03,869 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 92a0e8ea7b06a0a552c088efd7fb9a7b 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-22 00:08:03,869 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35499,1689984379745' in zk 2023-07-22 00:08:03,873 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 00:08:03,873 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:03,873 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 00:08:03,898 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:03,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:08:03,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:08:03,899 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:08:03,911 INFO [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c/.tmp/cf/acd6b9292c36474bb93fce68ba5a4a38 2023-07-22 00:08:03,918 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c/.tmp/cf/acd6b9292c36474bb93fce68ba5a4a38 as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c/cf/acd6b9292c36474bb93fce68ba5a4a38 2023-07-22 00:08:03,928 INFO [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c/cf/acd6b9292c36474bb93fce68ba5a4a38, entries=47, sequenceid=6, filesize=8 K 2023-07-22 00:08:03,930 INFO [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for cc1435506ff6dc097eaa584ee48aa83c in 61ms, sequenceid=6, compaction requested=false 2023-07-22 00:08:03,930 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-22 00:08:03,931 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc1435506ff6dc097eaa584ee48aa83c: 2023-07-22 00:08:03,931 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,939 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:08:03,939 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c/cf/acd6b9292c36474bb93fce68ba5a4a38] hfiles 2023-07-22 00:08:03,939 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c/cf/acd6b9292c36474bb93fce68ba5a4a38 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,949 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. completed. 2023-07-22 00:08:03,949 DEBUG [rs(jenkins-hbase4.apache.org,43309,1689984379801)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. 2023-07-22 00:08:03,949 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:08:03,949 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:08:03,949 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,949 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 00:08:03,949 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43309,1689984379801' in zk 2023-07-22 00:08:03,951 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 00:08:03,951 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,951 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:03,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,951 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 00:08:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:03,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:03,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:03,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:03,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:03,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:03,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:03,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:03,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43309,1689984379801': 2023-07-22 00:08:03,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-22 00:08:04,100 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:04,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:08:04,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:08:04,101 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-22 00:08:04,343 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b/.tmp/cf/5f9e47a07c984a489edab47542aec8a8 2023-07-22 00:08:04,350 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b/.tmp/cf/5f9e47a07c984a489edab47542aec8a8 as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b/cf/5f9e47a07c984a489edab47542aec8a8 2023-07-22 00:08:04,365 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b/cf/5f9e47a07c984a489edab47542aec8a8, entries=3, sequenceid=6, filesize=5.0 K 2023-07-22 00:08:04,366 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 92a0e8ea7b06a0a552c088efd7fb9a7b in 497ms, sequenceid=6, compaction requested=false 2023-07-22 00:08:04,368 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 92a0e8ea7b06a0a552c088efd7fb9a7b: 2023-07-22 00:08:04,368 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,369 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:08:04,369 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b/cf/5f9e47a07c984a489edab47542aec8a8] hfiles 2023-07-22 00:08:04,369 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b/cf/5f9e47a07c984a489edab47542aec8a8 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,394 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. completed. 2023-07-22 00:08:04,395 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. 2023-07-22 00:08:04,395 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:08:04,395 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:08:04,395 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:04,395 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-22 00:08:04,395 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40519,1689984379684' in zk 2023-07-22 00:08:04,397 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:04,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:04,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:04,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:04,397 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-22 00:08:04,397 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:04,397 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-22 00:08:04,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:04,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:04,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:04,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:04,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:04,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:04,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:04,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:04,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:04,402 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:04,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40519,1689984379684': 2023-07-22 00:08:04,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-22 00:08:04,402 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-22 00:08:04,402 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:08:04,402 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:08:04,402 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,402 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:08:04,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:08:04,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:08:04,403 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-22 00:08:04,404 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,404 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,405 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,406 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:04,405 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:04,404 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,404 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:04,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:04,406 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:04,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:04,410 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:04,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,411 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:04,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:04,413 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:04,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:04,414 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:04,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:04,414 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:04,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:04,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:04,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:04,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:04,421 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:04,422 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:04,422 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:04,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:04,422 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,422 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:04,422 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:04,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:04,422 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:04,422 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,422 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:04,422 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:04,422 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,422 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:04,422 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,422 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:04,422 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:04,422 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,422 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,422 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:04,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:04,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:04,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:04,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:04,422 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:04,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:04,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:04,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:04,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:04,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:04,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:04,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,538 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-22 00:08:04,538 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,539 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689984483796Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689984484422 (+626 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689984484422Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689984484433 (+11 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689984484450 (+17 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689984484538 (+88 ms) 2023-07-22 00:08:04,543 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-22 00:08:04,545 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 746 msec 2023-07-22 00:08:04,903 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:04,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-22 00:08:04,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:08:04,905 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984484905 2023-07-22 00:08:04,905 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34573, tgtDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984484905, rawTgtDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984484905, srcFsUri=hdfs://localhost:34573, srcDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:08:04,931 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34573, inputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:08:04,931 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-335263854_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984484905, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984484905/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:04,931 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34573, inputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d, snapshotDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-22 00:08:04,941 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984484905/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:05,008 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:05,009 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:05,009 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:05,010 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:05,010 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:05,011 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:05,011 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:05,109 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/hadoop-6662475585058392370.jar 2023-07-22 00:08:05,110 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:05,111 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:05,111 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:05,112 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:05,112 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:05,112 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:05,113 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 00:08:05,114 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 00:08:05,114 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 00:08:05,115 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 00:08:05,115 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 00:08:05,116 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 00:08:05,116 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 00:08:05,117 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 00:08:05,117 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 00:08:05,118 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 00:08:05,119 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:08:05,119 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:08:05,120 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:08:05,120 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:08:05,120 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:08:05,121 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:08:05,122 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:08:05,978 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0005_000001 (auth:SIMPLE) 2023-07-22 00:08:06,391 WARN [Listener at jenkins-hbase4.apache.org/40445] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 00:08:06,394 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-22 00:08:06,607 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:08:06,607 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:08:06,687 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0006_000001 (auth:SIMPLE) 2023-07-22 00:08:07,002 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 00:08:13,465 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0006_000001 (auth:SIMPLE) 2023-07-22 00:08:15,757 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 00:08:15,759 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 00:08:15,785 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:15,785 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 00:08:15,786 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 00:08:15,786 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1699920953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:15,788 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-22 00:08:15,788 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-22 00:08:15,788 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1699920953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984484905/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984484905/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:15,788 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984484905/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-22 00:08:15,789 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984484905/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-22 00:08:15,794 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-22 00:08:15,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-22 00:08:15,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 00:08:15,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 00:08:15,803 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984495803"}]},"ts":"1689984495803"} 2023-07-22 00:08:15,805 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-22 00:08:15,807 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-22 00:08:15,809 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92a0e8ea7b06a0a552c088efd7fb9a7b, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc1435506ff6dc097eaa584ee48aa83c, UNASSIGN}] 2023-07-22 00:08:15,815 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92a0e8ea7b06a0a552c088efd7fb9a7b, UNASSIGN 2023-07-22 00:08:15,815 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc1435506ff6dc097eaa584ee48aa83c, UNASSIGN 2023-07-22 00:08:15,816 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=92a0e8ea7b06a0a552c088efd7fb9a7b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:15,816 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=cc1435506ff6dc097eaa584ee48aa83c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:15,817 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984495816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984495816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984495816"}]},"ts":"1689984495816"} 2023-07-22 00:08:15,817 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984495816"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984495816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984495816"}]},"ts":"1689984495816"} 2023-07-22 00:08:15,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure cc1435506ff6dc097eaa584ee48aa83c, server=jenkins-hbase4.apache.org,43309,1689984379801}] 2023-07-22 00:08:15,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 92a0e8ea7b06a0a552c088efd7fb9a7b, server=jenkins-hbase4.apache.org,40519,1689984379684}] 2023-07-22 00:08:15,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 00:08:15,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cc1435506ff6dc097eaa584ee48aa83c 2023-07-22 00:08:15,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cc1435506ff6dc097eaa584ee48aa83c, disabling compactions & flushes 2023-07-22 00:08:15,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. 2023-07-22 00:08:15,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. 2023-07-22 00:08:15,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. after waiting 0 ms 2023-07-22 00:08:15,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. 2023-07-22 00:08:15,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 92a0e8ea7b06a0a552c088efd7fb9a7b 2023-07-22 00:08:15,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 92a0e8ea7b06a0a552c088efd7fb9a7b, disabling compactions & flushes 2023-07-22 00:08:15,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. 2023-07-22 00:08:15,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. 2023-07-22 00:08:15,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. after waiting 0 ms 2023-07-22 00:08:15,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. 2023-07-22 00:08:15,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:08:15,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:08:15,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c. 2023-07-22 00:08:15,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cc1435506ff6dc097eaa584ee48aa83c: 2023-07-22 00:08:15,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:08:15,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:08:15,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b. 2023-07-22 00:08:15,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 92a0e8ea7b06a0a552c088efd7fb9a7b: 2023-07-22 00:08:15,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cc1435506ff6dc097eaa584ee48aa83c 2023-07-22 00:08:15,994 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=cc1435506ff6dc097eaa584ee48aa83c, regionState=CLOSED 2023-07-22 00:08:15,994 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984495994"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984495994"}]},"ts":"1689984495994"} 2023-07-22 00:08:15,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 92a0e8ea7b06a0a552c088efd7fb9a7b 2023-07-22 00:08:15,995 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=92a0e8ea7b06a0a552c088efd7fb9a7b, regionState=CLOSED 2023-07-22 00:08:15,995 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689984495995"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984495995"}]},"ts":"1689984495995"} 2023-07-22 00:08:15,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-22 00:08:15,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure cc1435506ff6dc097eaa584ee48aa83c, server=jenkins-hbase4.apache.org,43309,1689984379801 in 177 msec 2023-07-22 00:08:15,999 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-22 00:08:15,999 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 92a0e8ea7b06a0a552c088efd7fb9a7b, server=jenkins-hbase4.apache.org,40519,1689984379684 in 175 msec 2023-07-22 00:08:16,000 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc1435506ff6dc097eaa584ee48aa83c, UNASSIGN in 189 msec 2023-07-22 00:08:16,001 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-22 00:08:16,001 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=92a0e8ea7b06a0a552c088efd7fb9a7b, UNASSIGN in 190 msec 2023-07-22 00:08:16,002 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984496002"}]},"ts":"1689984496002"} 2023-07-22 00:08:16,003 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-22 00:08:16,005 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-22 00:08:16,006 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 210 msec 2023-07-22 00:08:16,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-22 00:08:16,104 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-22 00:08:16,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,108 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,108 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,110 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40519] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,112 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,112 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,112 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,112 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,113 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 00:08:16,113 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 00:08:16,113 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 00:08:16,113 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-22 00:08:16,113 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b 2023-07-22 00:08:16,113 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c 2023-07-22 00:08:16,114 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,114 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,114 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,115 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:16,114 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:16,115 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,115 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:16,115 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:16,115 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b/cf, FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b/recovered.edits] 2023-07-22 00:08:16,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-22 00:08:16,116 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c/cf, FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c/recovered.edits] 2023-07-22 00:08:16,120 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b/cf/5f9e47a07c984a489edab47542aec8a8 to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b/cf/5f9e47a07c984a489edab47542aec8a8 2023-07-22 00:08:16,121 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c/cf/acd6b9292c36474bb93fce68ba5a4a38 to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c/cf/acd6b9292c36474bb93fce68ba5a4a38 2023-07-22 00:08:16,124 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b/recovered.edits/9.seqid to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b/recovered.edits/9.seqid 2023-07-22 00:08:16,124 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c/recovered.edits/9.seqid to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c/recovered.edits/9.seqid 2023-07-22 00:08:16,124 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/92a0e8ea7b06a0a552c088efd7fb9a7b 2023-07-22 00:08:16,124 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc1435506ff6dc097eaa584ee48aa83c 2023-07-22 00:08:16,125 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-22 00:08:16,127 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,129 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-22 00:08:16,131 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-22 00:08:16,132 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,132 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-22 00:08:16,132 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984496132"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:16,133 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984496132"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:16,135 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 00:08:16,135 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 92a0e8ea7b06a0a552c088efd7fb9a7b, NAME => 'testtb-testEmptyExportFileSystemState,,1689984482130.92a0e8ea7b06a0a552c088efd7fb9a7b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cc1435506ff6dc097eaa584ee48aa83c, NAME => 'testtb-testEmptyExportFileSystemState,1,1689984482130.cc1435506ff6dc097eaa584ee48aa83c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 00:08:16,135 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-22 00:08:16,135 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689984496135"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:16,141 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-22 00:08:16,143 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-22 00:08:16,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 39 msec 2023-07-22 00:08:16,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-22 00:08:16,217 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-22 00:08:16,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-22 00:08:16,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:16,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-22 00:08:16,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-22 00:08:16,283 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 761) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-923992901_1 at /127.0.0.1:52712 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1699920953_17 at /127.0.0.1:52488 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1699920953_17 at /127.0.0.1:52722 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4598 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:34399 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1699920953_17 at /127.0.0.1:50100 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-923992901_1 at /127.0.0.1:50064 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:40993 from appattempt_1689984388810_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=918 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=787 (was 644) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=6241 (was 6947) 2023-07-22 00:08:16,283 WARN [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-22 00:08:16,308 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=787, ProcessCount=180, AvailableMemoryMB=6239 2023-07-22 00:08:16,308 WARN [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-22 00:08:16,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-22 00:08:16,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:16,313 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-22 00:08:16,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-22 00:08:16,314 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-22 00:08:16,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 00:08:16,316 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43 2023-07-22 00:08:16,316 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97 2023-07-22 00:08:16,317 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43 empty. 2023-07-22 00:08:16,317 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97 empty. 2023-07-22 00:08:16,318 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43 2023-07-22 00:08:16,318 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97 2023-07-22 00:08:16,318 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-22 00:08:16,329 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-22 00:08:16,331 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 25213e98057f524253b2c33ec8bcaf97, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp 2023-07-22 00:08:16,331 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => c598fa6ead0fef338c4777d1a0d8fc43, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp 2023-07-22 00:08:16,352 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:08:16,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 25213e98057f524253b2c33ec8bcaf97, disabling compactions & flushes 2023-07-22 00:08:16,353 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. 2023-07-22 00:08:16,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. 2023-07-22 00:08:16,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. after waiting 0 ms 2023-07-22 00:08:16,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. 2023-07-22 00:08:16,353 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. 2023-07-22 00:08:16,353 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 25213e98057f524253b2c33ec8bcaf97: 2023-07-22 00:08:16,357 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:08:16,357 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing c598fa6ead0fef338c4777d1a0d8fc43, disabling compactions & flushes 2023-07-22 00:08:16,357 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. 2023-07-22 00:08:16,357 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. 2023-07-22 00:08:16,357 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. after waiting 0 ms 2023-07-22 00:08:16,357 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. 2023-07-22 00:08:16,357 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. 2023-07-22 00:08:16,357 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for c598fa6ead0fef338c4777d1a0d8fc43: 2023-07-22 00:08:16,360 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-22 00:08:16,361 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984496361"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984496361"}]},"ts":"1689984496361"} 2023-07-22 00:08:16,361 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984496361"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984496361"}]},"ts":"1689984496361"} 2023-07-22 00:08:16,364 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-22 00:08:16,370 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-22 00:08:16,370 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984496370"}]},"ts":"1689984496370"} 2023-07-22 00:08:16,372 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-22 00:08:16,376 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-22 00:08:16,377 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-22 00:08:16,377 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-22 00:08:16,378 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-22 00:08:16,378 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-22 00:08:16,378 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c598fa6ead0fef338c4777d1a0d8fc43, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=25213e98057f524253b2c33ec8bcaf97, ASSIGN}] 2023-07-22 00:08:16,381 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=25213e98057f524253b2c33ec8bcaf97, ASSIGN 2023-07-22 00:08:16,381 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c598fa6ead0fef338c4777d1a0d8fc43, ASSIGN 2023-07-22 00:08:16,382 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=25213e98057f524253b2c33ec8bcaf97, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35499,1689984379745; forceNewPlan=false, retain=false 2023-07-22 00:08:16,382 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c598fa6ead0fef338c4777d1a0d8fc43, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40519,1689984379684; forceNewPlan=false, retain=false 2023-07-22 00:08:16,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 00:08:16,532 INFO [jenkins-hbase4:42695] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-22 00:08:16,535 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c598fa6ead0fef338c4777d1a0d8fc43, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:16,535 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=25213e98057f524253b2c33ec8bcaf97, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:16,536 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984496535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984496535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984496535"}]},"ts":"1689984496535"} 2023-07-22 00:08:16,536 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984496535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984496535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984496535"}]},"ts":"1689984496535"} 2023-07-22 00:08:16,538 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure c598fa6ead0fef338c4777d1a0d8fc43, server=jenkins-hbase4.apache.org,40519,1689984379684}] 2023-07-22 00:08:16,539 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 25213e98057f524253b2c33ec8bcaf97, server=jenkins-hbase4.apache.org,35499,1689984379745}] 2023-07-22 00:08:16,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 00:08:16,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. 2023-07-22 00:08:16,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c598fa6ead0fef338c4777d1a0d8fc43, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43.', STARTKEY => '', ENDKEY => '1'} 2023-07-22 00:08:16,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. service=AccessControlService 2023-07-22 00:08:16,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:08:16,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c598fa6ead0fef338c4777d1a0d8fc43 2023-07-22 00:08:16,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:08:16,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c598fa6ead0fef338c4777d1a0d8fc43 2023-07-22 00:08:16,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c598fa6ead0fef338c4777d1a0d8fc43 2023-07-22 00:08:16,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. 2023-07-22 00:08:16,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 25213e98057f524253b2c33ec8bcaf97, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97.', STARTKEY => '1', ENDKEY => ''} 2023-07-22 00:08:16,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. service=AccessControlService 2023-07-22 00:08:16,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-22 00:08:16,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 25213e98057f524253b2c33ec8bcaf97 2023-07-22 00:08:16,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-22 00:08:16,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 25213e98057f524253b2c33ec8bcaf97 2023-07-22 00:08:16,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 25213e98057f524253b2c33ec8bcaf97 2023-07-22 00:08:16,703 INFO [StoreOpener-c598fa6ead0fef338c4777d1a0d8fc43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c598fa6ead0fef338c4777d1a0d8fc43 2023-07-22 00:08:16,704 INFO [StoreOpener-25213e98057f524253b2c33ec8bcaf97-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 25213e98057f524253b2c33ec8bcaf97 2023-07-22 00:08:16,704 DEBUG [StoreOpener-c598fa6ead0fef338c4777d1a0d8fc43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43/cf 2023-07-22 00:08:16,704 DEBUG [StoreOpener-c598fa6ead0fef338c4777d1a0d8fc43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43/cf 2023-07-22 00:08:16,705 INFO [StoreOpener-c598fa6ead0fef338c4777d1a0d8fc43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c598fa6ead0fef338c4777d1a0d8fc43 columnFamilyName cf 2023-07-22 00:08:16,705 DEBUG [StoreOpener-25213e98057f524253b2c33ec8bcaf97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97/cf 2023-07-22 00:08:16,705 DEBUG [StoreOpener-25213e98057f524253b2c33ec8bcaf97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97/cf 2023-07-22 00:08:16,706 INFO [StoreOpener-c598fa6ead0fef338c4777d1a0d8fc43-1] regionserver.HStore(310): Store=c598fa6ead0fef338c4777d1a0d8fc43/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:08:16,706 INFO [StoreOpener-25213e98057f524253b2c33ec8bcaf97-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25213e98057f524253b2c33ec8bcaf97 columnFamilyName cf 2023-07-22 00:08:16,707 INFO [StoreOpener-25213e98057f524253b2c33ec8bcaf97-1] regionserver.HStore(310): Store=25213e98057f524253b2c33ec8bcaf97/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-22 00:08:16,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43 2023-07-22 00:08:16,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43 2023-07-22 00:08:16,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97 2023-07-22 00:08:16,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97 2023-07-22 00:08:16,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c598fa6ead0fef338c4777d1a0d8fc43 2023-07-22 00:08:16,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 25213e98057f524253b2c33ec8bcaf97 2023-07-22 00:08:16,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:08:16,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-22 00:08:16,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 25213e98057f524253b2c33ec8bcaf97; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67361779, jitterRate=0.00376872718334198}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:08:16,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c598fa6ead0fef338c4777d1a0d8fc43; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59910435, jitterRate=-0.10726495087146759}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-22 00:08:16,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 25213e98057f524253b2c33ec8bcaf97: 2023-07-22 00:08:16,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c598fa6ead0fef338c4777d1a0d8fc43: 2023-07-22 00:08:16,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43., pid=108, masterSystemTime=1689984496692 2023-07-22 00:08:16,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97., pid=109, masterSystemTime=1689984496692 2023-07-22 00:08:16,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. 2023-07-22 00:08:16,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. 2023-07-22 00:08:16,721 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c598fa6ead0fef338c4777d1a0d8fc43, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:16,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. 2023-07-22 00:08:16,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. 2023-07-22 00:08:16,721 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984496720"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984496720"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984496720"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984496720"}]},"ts":"1689984496720"} 2023-07-22 00:08:16,721 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=25213e98057f524253b2c33ec8bcaf97, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:16,721 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984496721"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689984496721"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689984496721"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689984496721"}]},"ts":"1689984496721"} 2023-07-22 00:08:16,725 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-22 00:08:16,725 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure c598fa6ead0fef338c4777d1a0d8fc43, server=jenkins-hbase4.apache.org,40519,1689984379684 in 184 msec 2023-07-22 00:08:16,725 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-22 00:08:16,725 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 25213e98057f524253b2c33ec8bcaf97, server=jenkins-hbase4.apache.org,35499,1689984379745 in 184 msec 2023-07-22 00:08:16,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c598fa6ead0fef338c4777d1a0d8fc43, ASSIGN in 347 msec 2023-07-22 00:08:16,727 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-22 00:08:16,727 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=25213e98057f524253b2c33ec8bcaf97, ASSIGN in 347 msec 2023-07-22 00:08:16,728 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-22 00:08:16,728 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984496728"}]},"ts":"1689984496728"} 2023-07-22 00:08:16,730 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-22 00:08:16,732 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-22 00:08:16,732 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-22 00:08:16,734 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40519] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 00:08:16,739 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:16,739 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:16,739 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:16,739 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:16,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:16,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:16,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:16,742 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-22 00:08:16,743 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 431 msec 2023-07-22 00:08:16,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-22 00:08:16,919 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-22 00:08:16,919 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-22 00:08:16,919 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:08:16,922 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-22 00:08:16,923 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:08:16,923 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-22 00:08:16,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 00:08:16,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984496926 (current time:1689984496926). 2023-07-22 00:08:16,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:08:16,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x3d334fbf to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:08:16,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bbf4779, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:08:16,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:16,938 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:16,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d334fbf to 127.0.0.1:58666 2023-07-22 00:08:16,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:08:16,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x33566302 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:08:16,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@143f8c60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:08:16,949 DEBUG [hconnection-0x351a9511-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:16,953 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:16,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33566302 to 127.0.0.1:58666 2023-07-22 00:08:16,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:08:16,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 00:08:16,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:08:16,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 00:08:16,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 00:08:16,967 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 00:08:16,968 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689985096968 2023-07-22 00:08:16,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 00:08:16,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:16,968 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:08:16,968 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:08:16,971 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 00:08:16,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 00:08:16,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-22 00:08:16,973 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 00:08:16,974 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689985096974 2023-07-22 00:08:16,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:16,993 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-22 00:08:16,993 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:16,995 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-22 00:08:16,995 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-22 00:08:16,996 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:16,996 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:16,998 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:16,998 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:16,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:16,998 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:16,998 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:16,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:16,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:16,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:16,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:16,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:16,998 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:16,998 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:16,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:16,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:16,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:16,999 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:16,999 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:08:16,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:16,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:16,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:16,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 00:08:16,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 00:08:16,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:16,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,000 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 00:08:17,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,000 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 00:08:17,000 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:17,000 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 00:08:17,000 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-22 00:08:17,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-22 00:08:17,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,001 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 00:08:17,001 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:17,001 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 00:08:17,002 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,004 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 00:08:17,004 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 00:08:17,004 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:17,004 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 00:08:17,005 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 00:08:17,005 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 00:08:17,005 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 00:08:17,004 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 00:08:17,006 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 00:08:17,006 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 00:08:17,006 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 00:08:17,011 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,011 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,011 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,011 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,012 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,012 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,012 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:17,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,012 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,012 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:17,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,013 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,013 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:17,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 00:08:17,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2550609[Count = 1] remaining members to acquire global barrier 2023-07-22 00:08:17,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 00:08:17,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2550609[Count = 0] remaining members to acquire global barrier 2023-07-22 00:08:17,017 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-22 00:08:17,017 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,019 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,019 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,019 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,019 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,019 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 00:08:17,019 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 00:08:17,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,019 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43309,1689984379801' in zk 2023-07-22 00:08:17,019 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 00:08:17,019 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 00:08:17,020 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:08:17,020 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:08:17,020 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. 2023-07-22 00:08:17,020 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. started... 2023-07-22 00:08:17,020 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,020 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:08:17,022 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:08:17,022 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 25213e98057f524253b2c33ec8bcaf97: 2023-07-22 00:08:17,022 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. 2023-07-22 00:08:17,022 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:08:17,022 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 00:08:17,022 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. started... 2023-07-22 00:08:17,022 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:17,022 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,023 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 00:08:17,024 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c598fa6ead0fef338c4777d1a0d8fc43: 2023-07-22 00:08:17,024 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:08:17,024 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:08:17,024 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,024 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:08:17,024 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-22 00:08:17,035 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. completed. 2023-07-22 00:08:17,035 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. 2023-07-22 00:08:17,035 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. completed. 2023-07-22 00:08:17,035 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:08:17,035 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:08:17,036 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,035 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. 2023-07-22 00:08:17,036 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 00:08:17,036 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40519,1689984379684' in zk 2023-07-22 00:08:17,036 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:08:17,036 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:08:17,036 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,036 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 00:08:17,036 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35499,1689984379745' in zk 2023-07-22 00:08:17,037 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 00:08:17,037 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:17,037 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,037 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 00:08:17,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,039 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 00:08:17,039 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,039 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:17,039 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 00:08:17,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40519,1689984379684': 2023-07-22 00:08:17,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-22 00:08:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35499,1689984379745': 2023-07-22 00:08:17,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-22 00:08:17,052 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-22 00:08:17,053 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:08:17,053 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:08:17,053 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,053 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:08:17,055 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,055 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,055 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,055 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,055 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,055 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,055 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,056 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,057 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,058 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,060 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,060 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,061 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,064 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,064 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,064 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,065 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,065 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,065 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,065 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,065 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,065 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,065 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,065 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:17,065 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,067 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,067 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,068 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,068 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,068 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,068 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,068 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,069 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:17,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 00:08:17,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:08:17,070 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:08:17,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,156 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-22 00:08:17,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,157 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689984496968Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689984497065 (+97 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689984497065Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689984497071 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689984497094 (+23 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689984497156 (+62 ms) 2023-07-22 00:08:17,160 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 00:08:17,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 190 msec 2023-07-22 00:08:17,270 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:17,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 00:08:17,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:08:17,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40519] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:08:17,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35499] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. with WAL disabled. Data may be lost in the event of a crash. 2023-07-22 00:08:17,283 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,283 DEBUG [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. 2023-07-22 00:08:17,283 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-22 00:08:17,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 00:08:17,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689984497299 (current time:1689984497299). 2023-07-22 00:08:17,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-22 00:08:17,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x6a4180ce to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:08:17,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b12228a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:08:17,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:17,311 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:17,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a4180ce to 127.0.0.1:58666 2023-07-22 00:08:17,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:08:17,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(139): Connect 0x7ac41300 to 127.0.0.1:58666 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-22 00:08:17,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ce5bb66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-22 00:08:17,325 DEBUG [hconnection-0x6f9dc02-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-22 00:08:17,326 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-22 00:08:17,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ac41300 to 127.0.0.1:58666 2023-07-22 00:08:17,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:08:17,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-22 00:08:17,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-22 00:08:17,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 00:08:17,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 00:08:17,338 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 00:08:17,339 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689985097339 2023-07-22 00:08:17,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-22 00:08:17,339 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,340 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-22 00:08:17,340 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-22 00:08:17,341 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-22 00:08:17,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 00:08:17,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-22 00:08:17,344 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 00:08:17,345 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689985097345 2023-07-22 00:08:17,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,373 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-22 00:08:17,373 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:17,374 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-22 00:08:17,374 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-22 00:08:17,375 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,375 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,377 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,377 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,377 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,377 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,378 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,378 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,379 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,379 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-22 00:08:17,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 00:08:17,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 00:08:17,380 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 00:08:17,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,380 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 00:08:17,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-22 00:08:17,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,380 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-22 00:08:17,381 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,381 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 00:08:17,381 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,381 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:17,381 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 00:08:17,381 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:17,381 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,383 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 00:08:17,383 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 00:08:17,383 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 00:08:17,383 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 00:08:17,383 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 00:08:17,383 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43309,1689984379801' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 00:08:17,383 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-22 00:08:17,383 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-22 00:08:17,385 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-22 00:08:17,385 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-22 00:08:17,385 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-22 00:08:17,386 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,386 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,386 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,388 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,388 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,388 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,388 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:17,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,388 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,388 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:17,388 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,388 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-22 00:08:17,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40519,1689984379684' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 00:08:17,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19f6f3d3[Count = 1] remaining members to acquire global barrier 2023-07-22 00:08:17,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35499,1689984379745' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-22 00:08:17,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19f6f3d3[Count = 0] remaining members to acquire global barrier 2023-07-22 00:08:17,395 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-22 00:08:17,395 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,399 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,399 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,399 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,399 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 00:08:17,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,399 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 00:08:17,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,399 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43309,1689984379801' in zk 2023-07-22 00:08:17,400 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 00:08:17,399 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-22 00:08:17,399 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,400 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:08:17,400 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:08:17,400 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. 2023-07-22 00:08:17,400 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. started... 2023-07-22 00:08:17,400 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-22 00:08:17,400 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-22 00:08:17,400 INFO [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 25213e98057f524253b2c33ec8bcaf97 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-22 00:08:17,400 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,400 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. 2023-07-22 00:08:17,400 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-22 00:08:17,400 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. started... 2023-07-22 00:08:17,401 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c598fa6ead0fef338c4777d1a0d8fc43 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-22 00:08:17,402 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 00:08:17,402 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:17,402 DEBUG [member: 'jenkins-hbase4.apache.org,43309,1689984379801' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 00:08:17,427 INFO [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97/.tmp/cf/b76c469c7d42445590fc5fa200695b04 2023-07-22 00:08:17,429 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43/.tmp/cf/8f72cd4463e64de184547dcd2c744b16 2023-07-22 00:08:17,434 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97/.tmp/cf/b76c469c7d42445590fc5fa200695b04 as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97/cf/b76c469c7d42445590fc5fa200695b04 2023-07-22 00:08:17,435 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43/.tmp/cf/8f72cd4463e64de184547dcd2c744b16 as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43/cf/8f72cd4463e64de184547dcd2c744b16 2023-07-22 00:08:17,440 INFO [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97/cf/b76c469c7d42445590fc5fa200695b04, entries=46, sequenceid=6, filesize=7.9 K 2023-07-22 00:08:17,440 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:17,441 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43/cf/8f72cd4463e64de184547dcd2c744b16, entries=4, sequenceid=6, filesize=5.1 K 2023-07-22 00:08:17,441 INFO [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 25213e98057f524253b2c33ec8bcaf97 in 41ms, sequenceid=6, compaction requested=false 2023-07-22 00:08:17,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 00:08:17,443 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 25213e98057f524253b2c33ec8bcaf97: 2023-07-22 00:08:17,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-22 00:08:17,443 INFO [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for c598fa6ead0fef338c4777d1a0d8fc43 in 42ms, sequenceid=6, compaction requested=false 2023-07-22 00:08:17,443 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,443 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c598fa6ead0fef338c4777d1a0d8fc43: 2023-07-22 00:08:17,443 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:08:17,443 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97/cf/b76c469c7d42445590fc5fa200695b04] hfiles 2023-07-22 00:08:17,443 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-22 00:08:17,444 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,443 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97/cf/b76c469c7d42445590fc5fa200695b04 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,444 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-22 00:08:17,444 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43/cf/8f72cd4463e64de184547dcd2c744b16] hfiles 2023-07-22 00:08:17,444 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43/cf/8f72cd4463e64de184547dcd2c744b16 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,475 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. completed. 2023-07-22 00:08:17,475 DEBUG [rs(jenkins-hbase4.apache.org,35499,1689984379745)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. 2023-07-22 00:08:17,475 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:08:17,475 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:08:17,475 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,476 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 00:08:17,476 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35499,1689984379745' in zk 2023-07-22 00:08:17,479 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. completed. 2023-07-22 00:08:17,479 DEBUG [rs(jenkins-hbase4.apache.org,40519,1689984379684)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. 2023-07-22 00:08:17,479 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-22 00:08:17,479 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-22 00:08:17,479 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,479 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 00:08:17,479 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,479 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-22 00:08:17,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,479 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:17,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,480 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40519,1689984379684' in zk 2023-07-22 00:08:17,480 DEBUG [member: 'jenkins-hbase4.apache.org,35499,1689984379745' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 00:08:17,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,483 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-22 00:08:17,483 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,483 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:17,483 DEBUG [member: 'jenkins-hbase4.apache.org,40519,1689984379684' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-22 00:08:17,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35499,1689984379745': 2023-07-22 00:08:17,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35499,1689984379745' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-22 00:08:17,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40519,1689984379684': 2023-07-22 00:08:17,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40519,1689984379684' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-22 00:08:17,493 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-22 00:08:17,493 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-22 00:08:17,493 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-22 00:08:17,493 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,493 INFO [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-22 00:08:17,495 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,495 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,495 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,495 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,495 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-22 00:08:17,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-22 00:08:17,495 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,495 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,497 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-22 00:08:17,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,497 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-22 00:08:17,498 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-22 00:08:17,500 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,500 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,501 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,504 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,504 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,504 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,504 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,504 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,504 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-22 00:08:17,504 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-22 00:08:17,504 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-22 00:08:17,504 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,504 DEBUG [(jenkins-hbase4.apache.org,42695,1689984378224)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-22 00:08:17,504 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,504 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-22 00:08:17,504 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,507 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,507 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:17,507 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,507 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:17,507 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:08:17,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,507 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-22 00:08:17,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-22 00:08:17,507 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,526 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,552 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-22 00:08:17,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,553 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689984497339Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689984497504 (+165 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689984497504Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689984497511 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689984497520 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689984497552 (+32 ms) 2023-07-22 00:08:17,556 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-22 00:08:17,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 216 msec 2023-07-22 00:08:17,644 DEBUG [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-22 00:08:17,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-22 00:08:17,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-22 00:08:17,645 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984497645 2023-07-22 00:08:17,645 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34573, tgtDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984497645, rawTgtDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984497645, srcFsUri=hdfs://localhost:34573, srcDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:08:17,674 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34573, inputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d 2023-07-22 00:08:17,674 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-680980131_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984497645, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984497645/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,674 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34573, inputRoot=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d, snapshotDir=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-22 00:08:17,689 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984497645/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:17,726 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:17,726 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:17,727 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:17,727 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:17,728 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:17,728 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:17,729 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:17,813 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/hadoop-6264350823885899328.jar 2023-07-22 00:08:17,814 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:17,814 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:17,815 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:17,815 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:17,816 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:17,816 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-22 00:08:17,817 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-22 00:08:17,817 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-22 00:08:17,818 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-22 00:08:17,819 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-22 00:08:17,819 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-22 00:08:17,820 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-22 00:08:17,820 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-22 00:08:17,821 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-22 00:08:17,821 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-22 00:08:17,822 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-22 00:08:17,822 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:08:17,823 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:08:17,824 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:08:17,824 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:08:17,824 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-22 00:08:17,825 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:08:17,825 DEBUG [Listener at jenkins-hbase4.apache.org/40445] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-22 00:08:18,328 WARN [Listener at jenkins-hbase4.apache.org/40445] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-22 00:08:18,330 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-22 00:08:18,332 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-22 00:08:20,903 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:08:20,903 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-22 00:08:20,906 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0006_000001 (auth:SIMPLE) 2023-07-22 00:08:20,994 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0007_000001 (auth:SIMPLE) 2023-07-22 00:08:21,609 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 00:08:27,251 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0007_000001 (auth:SIMPLE) 2023-07-22 00:08:29,690 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0007_000001 (auth:SIMPLE) 2023-07-22 00:08:34,694 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0007_000001 (auth:SIMPLE) 2023-07-22 00:08:36,703 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-22 00:08:36,703 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-22 00:08:36,717 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,717 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-22 00:08:36,718 INFO [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-22 00:08:36,718 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1699920953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,718 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-22 00:08:36,718 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-22 00:08:36,719 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1699920953_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984497645/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984497645/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,719 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984497645/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-22 00:08:36,719 DEBUG [Listener at jenkins-hbase4.apache.org/40445] snapshot.TestExportSnapshot(367): hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/export-test/export-1689984497645/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-22 00:08:36,726 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:36,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 00:08:36,733 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984516733"}]},"ts":"1689984516733"} 2023-07-22 00:08:36,734 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-22 00:08:36,736 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-22 00:08:36,738 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c598fa6ead0fef338c4777d1a0d8fc43, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=25213e98057f524253b2c33ec8bcaf97, UNASSIGN}] 2023-07-22 00:08:36,741 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c598fa6ead0fef338c4777d1a0d8fc43, UNASSIGN 2023-07-22 00:08:36,741 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=25213e98057f524253b2c33ec8bcaf97, UNASSIGN 2023-07-22 00:08:36,741 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c598fa6ead0fef338c4777d1a0d8fc43, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:08:36,742 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=25213e98057f524253b2c33ec8bcaf97, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:08:36,742 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984516741"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984516741"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984516741"}]},"ts":"1689984516741"} 2023-07-22 00:08:36,742 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984516742"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689984516742"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689984516742"}]},"ts":"1689984516742"} 2023-07-22 00:08:36,744 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure c598fa6ead0fef338c4777d1a0d8fc43, server=jenkins-hbase4.apache.org,40519,1689984379684}] 2023-07-22 00:08:36,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 25213e98057f524253b2c33ec8bcaf97, server=jenkins-hbase4.apache.org,35499,1689984379745}] 2023-07-22 00:08:36,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 00:08:36,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c598fa6ead0fef338c4777d1a0d8fc43 2023-07-22 00:08:36,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c598fa6ead0fef338c4777d1a0d8fc43, disabling compactions & flushes 2023-07-22 00:08:36,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. 2023-07-22 00:08:36,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. 2023-07-22 00:08:36,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. after waiting 0 ms 2023-07-22 00:08:36,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. 2023-07-22 00:08:36,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 25213e98057f524253b2c33ec8bcaf97 2023-07-22 00:08:36,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 25213e98057f524253b2c33ec8bcaf97, disabling compactions & flushes 2023-07-22 00:08:36,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. 2023-07-22 00:08:36,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. 2023-07-22 00:08:36,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. after waiting 0 ms 2023-07-22 00:08:36,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. 2023-07-22 00:08:36,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:08:36,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:08:36,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:08:36,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:08:36,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97. 2023-07-22 00:08:36,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 25213e98057f524253b2c33ec8bcaf97: 2023-07-22 00:08:36,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43. 2023-07-22 00:08:36,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c598fa6ead0fef338c4777d1a0d8fc43: 2023-07-22 00:08:36,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 25213e98057f524253b2c33ec8bcaf97 2023-07-22 00:08:36,965 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=25213e98057f524253b2c33ec8bcaf97, regionState=CLOSED 2023-07-22 00:08:36,965 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984516965"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984516965"}]},"ts":"1689984516965"} 2023-07-22 00:08:36,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c598fa6ead0fef338c4777d1a0d8fc43 2023-07-22 00:08:36,966 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c598fa6ead0fef338c4777d1a0d8fc43, regionState=CLOSED 2023-07-22 00:08:36,967 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689984516966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689984516966"}]},"ts":"1689984516966"} 2023-07-22 00:08:36,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-22 00:08:36,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-22 00:08:36,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 25213e98057f524253b2c33ec8bcaf97, server=jenkins-hbase4.apache.org,35499,1689984379745 in 222 msec 2023-07-22 00:08:36,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure c598fa6ead0fef338c4777d1a0d8fc43, server=jenkins-hbase4.apache.org,40519,1689984379684 in 224 msec 2023-07-22 00:08:36,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c598fa6ead0fef338c4777d1a0d8fc43, UNASSIGN in 232 msec 2023-07-22 00:08:36,972 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-22 00:08:36,972 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=25213e98057f524253b2c33ec8bcaf97, UNASSIGN in 232 msec 2023-07-22 00:08:36,973 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689984516972"}]},"ts":"1689984516972"} 2023-07-22 00:08:36,974 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-22 00:08:36,976 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-22 00:08:36,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 250 msec 2023-07-22 00:08:37,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-22 00:08:37,036 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-22 00:08:37,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,040 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,043 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,044 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40519] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,048 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,048 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,048 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,048 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 00:08:37,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 00:08:37,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 00:08:37,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-22 00:08:37,049 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,049 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,050 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,050 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:37,050 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:37,050 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,050 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:37,050 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-22 00:08:37,051 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43 2023-07-22 00:08:37,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-22 00:08:37,051 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97 2023-07-22 00:08:37,053 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43/cf, FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43/recovered.edits] 2023-07-22 00:08:37,055 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97/cf, FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97/recovered.edits] 2023-07-22 00:08:37,058 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43/cf/8f72cd4463e64de184547dcd2c744b16 to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43/cf/8f72cd4463e64de184547dcd2c744b16 2023-07-22 00:08:37,060 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97/cf/b76c469c7d42445590fc5fa200695b04 to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97/cf/b76c469c7d42445590fc5fa200695b04 2023-07-22 00:08:37,062 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43/recovered.edits/9.seqid to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43/recovered.edits/9.seqid 2023-07-22 00:08:37,062 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c598fa6ead0fef338c4777d1a0d8fc43 2023-07-22 00:08:37,063 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97/recovered.edits/9.seqid to hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97/recovered.edits/9.seqid 2023-07-22 00:08:37,063 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/25213e98057f524253b2c33ec8bcaf97 2023-07-22 00:08:37,063 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-22 00:08:37,065 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,067 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-22 00:08:37,072 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-22 00:08:37,073 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,073 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-22 00:08:37,074 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984517073"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:37,074 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689984517073"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:37,078 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-22 00:08:37,078 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c598fa6ead0fef338c4777d1a0d8fc43, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689984496309.c598fa6ead0fef338c4777d1a0d8fc43.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 25213e98057f524253b2c33ec8bcaf97, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689984496309.25213e98057f524253b2c33ec8bcaf97.', STARTKEY => '1', ENDKEY => ''}] 2023-07-22 00:08:37,078 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-22 00:08:37,078 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689984517078"}]},"ts":"9223372036854775807"} 2023-07-22 00:08:37,079 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-22 00:08:37,081 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,082 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 44 msec 2023-07-22 00:08:37,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-22 00:08:37,152 INFO [Listener at jenkins-hbase4.apache.org/40445] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-22 00:08:37,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-22 00:08:37,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-22 00:08:37,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42695] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-22 00:08:37,199 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 763) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1699920953_17 at /127.0.0.1:42322 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1570060383_1 at /127.0.0.1:42302 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1699920953_17 at /127.0.0.1:44220 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1988292020_17 at /127.0.0.1:56054 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5208 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase4.apache.org/172.31.14.131:35937 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1570060383_1 at /127.0.0.1:56028 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x48dedf1b-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 918), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=851 (was 787) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 180), AvailableMemoryMB=6403 (was 6239) - AvailableMemoryMB LEAK? - 2023-07-22 00:08:37,199 WARN [Listener at jenkins-hbase4.apache.org/40445] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-22 00:08:37,199 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-22 00:08:37,211 INFO [Listener at jenkins-hbase4.apache.org/40445] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 00:08:40,883 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689984388810_0007_000001 (auth:SIMPLE) 2023-07-22 00:08:42,521 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-22 00:08:51,328 INFO [Listener at jenkins-hbase4.apache.org/40445] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 00:09:05,444 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 00:09:05,445 INFO [Listener at jenkins-hbase4.apache.org/40445] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 00:09:05,552 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-22 00:09:05,557 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-22 00:09:05,558 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 00:09:05,569 INFO [Listener at jenkins-hbase4.apache.org/40445] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-22 00:09:05,672 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-22 00:09:05,672 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-22 00:09:05,672 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-22 00:09:05,672 INFO [Listener at jenkins-hbase4.apache.org/40445] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-22 00:09:05,672 DEBUG [Listener at jenkins-hbase4.apache.org/40445] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68214c6c to 127.0.0.1:58666 2023-07-22 00:09:05,673 DEBUG [Listener at jenkins-hbase4.apache.org/40445] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:05,673 DEBUG [Listener at jenkins-hbase4.apache.org/40445] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-22 00:09:05,673 DEBUG [Listener at jenkins-hbase4.apache.org/40445] util.JVMClusterUtil(257): Found active master hash=1655812806, stopped=false 2023-07-22 00:09:05,673 DEBUG [Listener at jenkins-hbase4.apache.org/40445] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:09:05,673 DEBUG [Listener at jenkins-hbase4.apache.org/40445] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-22 00:09:05,673 INFO [Listener at jenkins-hbase4.apache.org/40445] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42695,1689984378224 2023-07-22 00:09:05,676 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 00:09:05,676 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 00:09:05,676 INFO [Listener at jenkins-hbase4.apache.org/40445] procedure2.ProcedureExecutor(629): Stopping 2023-07-22 00:09:05,676 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 00:09:05,676 DEBUG [Listener at jenkins-hbase4.apache.org/40445] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fca17b4 to 127.0.0.1:58666 2023-07-22 00:09:05,676 DEBUG [Listener at jenkins-hbase4.apache.org/40445] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:05,676 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-22 00:09:05,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 00:09:05,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 00:09:05,677 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:09:05,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 00:09:05,677 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-22 00:09:05,677 INFO [Listener at jenkins-hbase4.apache.org/40445] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40519,1689984379684' ***** 2023-07-22 00:09:05,677 DEBUG [Listener at jenkins-hbase4.apache.org/40445] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:09:05,677 INFO [Listener at jenkins-hbase4.apache.org/40445] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 00:09:05,677 INFO [Listener at jenkins-hbase4.apache.org/40445] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35499,1689984379745' ***** 2023-07-22 00:09:05,677 DEBUG [Listener at jenkins-hbase4.apache.org/40445] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:09:05,678 INFO [Listener at jenkins-hbase4.apache.org/40445] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 00:09:05,678 INFO [Listener at jenkins-hbase4.apache.org/40445] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43309,1689984379801' ***** 2023-07-22 00:09:05,678 DEBUG [Listener at jenkins-hbase4.apache.org/40445] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:09:05,678 INFO [Listener at jenkins-hbase4.apache.org/40445] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-22 00:09:05,678 INFO [RS:0;jenkins-hbase4:40519] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 00:09:05,678 INFO [RS:2;jenkins-hbase4:43309] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 00:09:05,678 INFO [RS:0;jenkins-hbase4:40519] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 00:09:05,678 INFO [RS:1;jenkins-hbase4:35499] regionserver.HeapMemoryManager(220): Stopping 2023-07-22 00:09:05,678 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 00:09:05,678 INFO [RS:1;jenkins-hbase4:35499] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 00:09:05,678 INFO [RS:2;jenkins-hbase4:43309] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-22 00:09:05,678 INFO [RS:1;jenkins-hbase4:35499] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 00:09:05,678 INFO [RS:2;jenkins-hbase4:43309] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 00:09:05,678 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 00:09:05,678 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-22 00:09:05,678 INFO [RS:1;jenkins-hbase4:35499] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:09:05,678 INFO [RS:2;jenkins-hbase4:43309] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:09:05,678 DEBUG [RS:1;jenkins-hbase4:35499] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bf66e8f to 127.0.0.1:58666 2023-07-22 00:09:05,679 DEBUG [RS:2;jenkins-hbase4:43309] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1953db9a to 127.0.0.1:58666 2023-07-22 00:09:05,678 INFO [RS:0;jenkins-hbase4:40519] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-22 00:09:05,679 DEBUG [RS:2;jenkins-hbase4:43309] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:05,679 DEBUG [RS:1;jenkins-hbase4:35499] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:05,681 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 00:09:05,682 INFO [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(3305): Received CLOSE for 7da5bf6a3203bfd27ef0fd7fabfa8b94 2023-07-22 00:09:05,682 INFO [RS:2;jenkins-hbase4:43309] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43309,1689984379801; all regions closed. 2023-07-22 00:09:05,682 INFO [RS:1;jenkins-hbase4:35499] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35499,1689984379745; all regions closed. 2023-07-22 00:09:05,682 INFO [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(3305): Received CLOSE for 7a25471be2b1178d4a02da04fc0f1b60 2023-07-22 00:09:05,682 INFO [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:09:05,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7da5bf6a3203bfd27ef0fd7fabfa8b94, disabling compactions & flushes 2023-07-22 00:09:05,683 DEBUG [RS:0;jenkins-hbase4:40519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ebbd897 to 127.0.0.1:58666 2023-07-22 00:09:05,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94. 2023-07-22 00:09:05,683 DEBUG [RS:0;jenkins-hbase4:40519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:05,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94. 2023-07-22 00:09:05,683 INFO [RS:0;jenkins-hbase4:40519] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 00:09:05,683 INFO [RS:0;jenkins-hbase4:40519] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 00:09:05,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94. after waiting 0 ms 2023-07-22 00:09:05,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94. 2023-07-22 00:09:05,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7da5bf6a3203bfd27ef0fd7fabfa8b94 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-22 00:09:05,683 INFO [RS:0;jenkins-hbase4:40519] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 00:09:05,684 INFO [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-22 00:09:05,684 INFO [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-22 00:09:05,684 DEBUG [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(1478): Online Regions={7da5bf6a3203bfd27ef0fd7fabfa8b94=hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94., 1588230740=hbase:meta,,1.1588230740, 7a25471be2b1178d4a02da04fc0f1b60=hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60.} 2023-07-22 00:09:05,685 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-22 00:09:05,685 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-22 00:09:05,685 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-22 00:09:05,685 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-22 00:09:05,685 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-22 00:09:05,685 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-22 00:09:05,686 DEBUG [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(1504): Waiting on 1588230740, 7a25471be2b1178d4a02da04fc0f1b60, 7da5bf6a3203bfd27ef0fd7fabfa8b94 2023-07-22 00:09:05,690 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 00:09:05,721 DEBUG [RS:1;jenkins-hbase4:35499] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/oldWALs 2023-07-22 00:09:05,721 DEBUG [RS:2;jenkins-hbase4:43309] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/oldWALs 2023-07-22 00:09:05,721 INFO [RS:2;jenkins-hbase4:43309] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43309%2C1689984379801:(num 1689984382057) 2023-07-22 00:09:05,721 INFO [RS:1;jenkins-hbase4:35499] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35499%2C1689984379745:(num 1689984382055) 2023-07-22 00:09:05,721 DEBUG [RS:2;jenkins-hbase4:43309] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:05,721 DEBUG [RS:1;jenkins-hbase4:35499] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:05,721 INFO [RS:2;jenkins-hbase4:43309] regionserver.LeaseManager(133): Closed leases 2023-07-22 00:09:05,721 INFO [RS:1;jenkins-hbase4:35499] regionserver.LeaseManager(133): Closed leases 2023-07-22 00:09:05,727 INFO [RS:2;jenkins-hbase4:43309] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-22 00:09:05,728 INFO [RS:1;jenkins-hbase4:35499] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-22 00:09:05,728 INFO [RS:2;jenkins-hbase4:43309] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 00:09:05,728 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 00:09:05,728 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 00:09:05,728 INFO [RS:2;jenkins-hbase4:43309] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 00:09:05,728 INFO [RS:1;jenkins-hbase4:35499] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-22 00:09:05,729 INFO [RS:2;jenkins-hbase4:43309] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 00:09:05,729 INFO [RS:1;jenkins-hbase4:35499] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-22 00:09:05,729 INFO [RS:1;jenkins-hbase4:35499] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-22 00:09:05,730 INFO [RS:2;jenkins-hbase4:43309] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43309 2023-07-22 00:09:05,731 INFO [RS:1;jenkins-hbase4:35499] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35499 2023-07-22 00:09:05,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/acl/7da5bf6a3203bfd27ef0fd7fabfa8b94/.tmp/l/3f1eb61a44f2422982ed9fb00322e861 2023-07-22 00:09:05,735 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/.tmp/info/2cb4fe330e7844fbad3719acb86e27a4 2023-07-22 00:09:05,738 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:09:05,738 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:09:05,738 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 00:09:05,738 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 00:09:05,738 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35499,1689984379745 2023-07-22 00:09:05,739 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 00:09:05,738 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 00:09:05,739 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:09:05,739 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:09:05,740 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43309,1689984379801 2023-07-22 00:09:05,741 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43309,1689984379801] 2023-07-22 00:09:05,742 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43309,1689984379801; numProcessing=1 2023-07-22 00:09:05,743 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43309,1689984379801 already deleted, retry=false 2023-07-22 00:09:05,743 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43309,1689984379801 expired; onlineServers=2 2023-07-22 00:09:05,743 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35499,1689984379745] 2023-07-22 00:09:05,743 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35499,1689984379745; numProcessing=2 2023-07-22 00:09:05,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f1eb61a44f2422982ed9fb00322e861 2023-07-22 00:09:05,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cb4fe330e7844fbad3719acb86e27a4 2023-07-22 00:09:05,744 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35499,1689984379745 already deleted, retry=false 2023-07-22 00:09:05,744 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35499,1689984379745 expired; onlineServers=1 2023-07-22 00:09:05,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/acl/7da5bf6a3203bfd27ef0fd7fabfa8b94/.tmp/l/3f1eb61a44f2422982ed9fb00322e861 as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/acl/7da5bf6a3203bfd27ef0fd7fabfa8b94/l/3f1eb61a44f2422982ed9fb00322e861 2023-07-22 00:09:05,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f1eb61a44f2422982ed9fb00322e861 2023-07-22 00:09:05,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/acl/7da5bf6a3203bfd27ef0fd7fabfa8b94/l/3f1eb61a44f2422982ed9fb00322e861, entries=7, sequenceid=18, filesize=5.2 K 2023-07-22 00:09:05,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 7da5bf6a3203bfd27ef0fd7fabfa8b94 in 67ms, sequenceid=18, compaction requested=false 2023-07-22 00:09:05,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/acl/7da5bf6a3203bfd27ef0fd7fabfa8b94/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-22 00:09:05,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:09:05,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94. 2023-07-22 00:09:05,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7da5bf6a3203bfd27ef0fd7fabfa8b94: 2023-07-22 00:09:05,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689984383566.7da5bf6a3203bfd27ef0fd7fabfa8b94. 2023-07-22 00:09:05,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7a25471be2b1178d4a02da04fc0f1b60, disabling compactions & flushes 2023-07-22 00:09:05,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60. 2023-07-22 00:09:05,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60. 2023-07-22 00:09:05,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60. after waiting 0 ms 2023-07-22 00:09:05,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60. 2023-07-22 00:09:05,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7a25471be2b1178d4a02da04fc0f1b60 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-22 00:09:05,759 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/.tmp/rep_barrier/2aea04746c504430bb5a2497cc5f148a 2023-07-22 00:09:05,763 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2aea04746c504430bb5a2497cc5f148a 2023-07-22 00:09:05,767 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-22 00:09:05,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/namespace/7a25471be2b1178d4a02da04fc0f1b60/.tmp/info/e69ebbfef67946c382f90dc3a602ebae 2023-07-22 00:09:05,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/.tmp/table/4016811f86c8461b9287c56b077a1be0 2023-07-22 00:09:05,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/namespace/7a25471be2b1178d4a02da04fc0f1b60/.tmp/info/e69ebbfef67946c382f90dc3a602ebae as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/namespace/7a25471be2b1178d4a02da04fc0f1b60/info/e69ebbfef67946c382f90dc3a602ebae 2023-07-22 00:09:05,794 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4016811f86c8461b9287c56b077a1be0 2023-07-22 00:09:05,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/namespace/7a25471be2b1178d4a02da04fc0f1b60/info/e69ebbfef67946c382f90dc3a602ebae, entries=2, sequenceid=6, filesize=4.8 K 2023-07-22 00:09:05,795 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/.tmp/info/2cb4fe330e7844fbad3719acb86e27a4 as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/info/2cb4fe330e7844fbad3719acb86e27a4 2023-07-22 00:09:05,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7a25471be2b1178d4a02da04fc0f1b60 in 38ms, sequenceid=6, compaction requested=false 2023-07-22 00:09:05,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/namespace/7a25471be2b1178d4a02da04fc0f1b60/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-22 00:09:05,802 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2cb4fe330e7844fbad3719acb86e27a4 2023-07-22 00:09:05,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:09:05,802 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/info/2cb4fe330e7844fbad3719acb86e27a4, entries=48, sequenceid=131, filesize=10.3 K 2023-07-22 00:09:05,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60. 2023-07-22 00:09:05,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7a25471be2b1178d4a02da04fc0f1b60: 2023-07-22 00:09:05,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689984382774.7a25471be2b1178d4a02da04fc0f1b60. 2023-07-22 00:09:05,803 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/.tmp/rep_barrier/2aea04746c504430bb5a2497cc5f148a as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/rep_barrier/2aea04746c504430bb5a2497cc5f148a 2023-07-22 00:09:05,807 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2aea04746c504430bb5a2497cc5f148a 2023-07-22 00:09:05,807 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/rep_barrier/2aea04746c504430bb5a2497cc5f148a, entries=13, sequenceid=131, filesize=6.4 K 2023-07-22 00:09:05,808 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/.tmp/table/4016811f86c8461b9287c56b077a1be0 as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/table/4016811f86c8461b9287c56b077a1be0 2023-07-22 00:09:05,812 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4016811f86c8461b9287c56b077a1be0 2023-07-22 00:09:05,812 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/table/4016811f86c8461b9287c56b077a1be0, entries=24, sequenceid=131, filesize=6.9 K 2023-07-22 00:09:05,813 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 128ms, sequenceid=131, compaction requested=false 2023-07-22 00:09:05,821 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-22 00:09:05,822 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-22 00:09:05,822 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-22 00:09:05,823 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-22 00:09:05,823 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-22 00:09:05,823 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-22 00:09:05,841 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 00:09:05,841 INFO [RS:1;jenkins-hbase4:35499] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35499,1689984379745; zookeeper connection closed. 2023-07-22 00:09:05,841 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:35499-0x1018a59a4ce0002, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 00:09:05,842 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@776f5bba] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@776f5bba 2023-07-22 00:09:05,886 INFO [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40519,1689984379684; all regions closed. 2023-07-22 00:09:05,892 DEBUG [RS:0;jenkins-hbase4:40519] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/oldWALs 2023-07-22 00:09:05,892 INFO [RS:0;jenkins-hbase4:40519] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40519%2C1689984379684.meta:.meta(num 1689984382358) 2023-07-22 00:09:05,902 DEBUG [RS:0;jenkins-hbase4:40519] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/oldWALs 2023-07-22 00:09:05,902 INFO [RS:0;jenkins-hbase4:40519] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40519%2C1689984379684:(num 1689984382055) 2023-07-22 00:09:05,903 DEBUG [RS:0;jenkins-hbase4:40519] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:05,903 INFO [RS:0;jenkins-hbase4:40519] regionserver.LeaseManager(133): Closed leases 2023-07-22 00:09:05,903 INFO [RS:0;jenkins-hbase4:40519] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-22 00:09:05,903 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 00:09:05,904 INFO [RS:0;jenkins-hbase4:40519] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40519 2023-07-22 00:09:05,906 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40519,1689984379684 2023-07-22 00:09:05,906 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-22 00:09:05,907 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40519,1689984379684] 2023-07-22 00:09:05,908 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40519,1689984379684; numProcessing=3 2023-07-22 00:09:05,941 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 00:09:05,941 INFO [RS:2;jenkins-hbase4:43309] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43309,1689984379801; zookeeper connection closed. 2023-07-22 00:09:05,941 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:43309-0x1018a59a4ce0003, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 00:09:05,942 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@271a0e3c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@271a0e3c 2023-07-22 00:09:06,008 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 00:09:06,008 INFO [RS:0;jenkins-hbase4:40519] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40519,1689984379684; zookeeper connection closed. 2023-07-22 00:09:06,008 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): regionserver:40519-0x1018a59a4ce0001, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 00:09:06,009 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6177be27] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6177be27 2023-07-22 00:09:06,009 INFO [Listener at jenkins-hbase4.apache.org/40445] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-22 00:09:06,009 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40519,1689984379684 already deleted, retry=false 2023-07-22 00:09:06,009 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40519,1689984379684 expired; onlineServers=0 2023-07-22 00:09:06,009 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42695,1689984378224' ***** 2023-07-22 00:09:06,009 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-22 00:09:06,010 DEBUG [M:0;jenkins-hbase4:42695] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@238cb8fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-22 00:09:06,010 INFO [M:0;jenkins-hbase4:42695] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42695,1689984378224 2023-07-22 00:09:06,010 INFO [M:0;jenkins-hbase4:42695] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42695,1689984378224; all regions closed. 2023-07-22 00:09:06,010 DEBUG [M:0;jenkins-hbase4:42695] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-22 00:09:06,010 DEBUG [M:0;jenkins-hbase4:42695] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-22 00:09:06,010 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-22 00:09:06,010 DEBUG [M:0;jenkins-hbase4:42695] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-22 00:09:06,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689984381494] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689984381494,5,FailOnTimeoutGroup] 2023-07-22 00:09:06,010 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689984381503] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689984381503,5,FailOnTimeoutGroup] 2023-07-22 00:09:06,010 INFO [M:0;jenkins-hbase4:42695] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-22 00:09:06,011 INFO [M:0;jenkins-hbase4:42695] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-22 00:09:06,011 INFO [M:0;jenkins-hbase4:42695] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-22 00:09:06,011 DEBUG [M:0;jenkins-hbase4:42695] master.HMaster(1512): Stopping service threads 2023-07-22 00:09:06,011 INFO [M:0;jenkins-hbase4:42695] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-22 00:09:06,011 ERROR [M:0;jenkins-hbase4:42695] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-22 00:09:06,012 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-22 00:09:06,012 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-22 00:09:06,012 INFO [M:0;jenkins-hbase4:42695] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-22 00:09:06,012 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-22 00:09:06,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-22 00:09:06,012 DEBUG [M:0;jenkins-hbase4:42695] zookeeper.ZKUtil(398): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-22 00:09:06,012 WARN [M:0;jenkins-hbase4:42695] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-22 00:09:06,013 INFO [M:0;jenkins-hbase4:42695] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-22 00:09:06,013 INFO [M:0;jenkins-hbase4:42695] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-22 00:09:06,014 DEBUG [M:0;jenkins-hbase4:42695] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-22 00:09:06,014 INFO [M:0;jenkins-hbase4:42695] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 00:09:06,014 DEBUG [M:0;jenkins-hbase4:42695] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 00:09:06,014 DEBUG [M:0;jenkins-hbase4:42695] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-22 00:09:06,014 DEBUG [M:0;jenkins-hbase4:42695] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 00:09:06,014 INFO [M:0;jenkins-hbase4:42695] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.06 KB heapSize=449.27 KB 2023-07-22 00:09:06,031 INFO [M:0;jenkins-hbase4:42695] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.06 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f178613515b44985aaef8a3bd49f14ed 2023-07-22 00:09:06,035 INFO [M:0;jenkins-hbase4:42695] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f178613515b44985aaef8a3bd49f14ed 2023-07-22 00:09:06,036 DEBUG [M:0;jenkins-hbase4:42695] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f178613515b44985aaef8a3bd49f14ed as hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f178613515b44985aaef8a3bd49f14ed 2023-07-22 00:09:06,041 INFO [M:0;jenkins-hbase4:42695] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f178613515b44985aaef8a3bd49f14ed 2023-07-22 00:09:06,041 INFO [M:0;jenkins-hbase4:42695] regionserver.HStore(1080): Added hdfs://localhost:34573/user/jenkins/test-data/053bd038-56d3-621d-8e95-5a68f4b22d8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f178613515b44985aaef8a3bd49f14ed, entries=119, sequenceid=899, filesize=28.4 K 2023-07-22 00:09:06,042 INFO [M:0;jenkins-hbase4:42695] regionserver.HRegion(2948): Finished flush of dataSize ~373.06 KB/382016, heapSize ~449.26 KB/460040, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=899, compaction requested=false 2023-07-22 00:09:06,044 INFO [M:0;jenkins-hbase4:42695] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-22 00:09:06,044 DEBUG [M:0;jenkins-hbase4:42695] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-22 00:09:06,048 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-22 00:09:06,048 INFO [M:0;jenkins-hbase4:42695] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-22 00:09:06,049 INFO [M:0;jenkins-hbase4:42695] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42695 2023-07-22 00:09:06,052 DEBUG [M:0;jenkins-hbase4:42695] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42695,1689984378224 already deleted, retry=false 2023-07-22 00:09:06,153 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 00:09:06,153 DEBUG [Listener at localhost/38513-EventThread] zookeeper.ZKWatcher(600): master:42695-0x1018a59a4ce0000, quorum=127.0.0.1:58666, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-22 00:09:06,153 INFO [M:0;jenkins-hbase4:42695] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42695,1689984378224; zookeeper connection closed. 2023-07-22 00:09:06,155 WARN [Listener at jenkins-hbase4.apache.org/40445] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 00:09:06,159 INFO [Listener at jenkins-hbase4.apache.org/40445] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 00:09:06,264 WARN [BP-824911289-172.31.14.131-1689984374130 heartbeating to localhost/127.0.0.1:34573] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 00:09:06,264 WARN [BP-824911289-172.31.14.131-1689984374130 heartbeating to localhost/127.0.0.1:34573] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-824911289-172.31.14.131-1689984374130 (Datanode Uuid a3fd7a08-15de-4370-a234-794df38661d0) service to localhost/127.0.0.1:34573 2023-07-22 00:09:06,266 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/cluster_0032ba5a-a217-3173-3cbc-083e8f7fc05b/dfs/data/data5/current/BP-824911289-172.31.14.131-1689984374130] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 00:09:06,267 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/cluster_0032ba5a-a217-3173-3cbc-083e8f7fc05b/dfs/data/data6/current/BP-824911289-172.31.14.131-1689984374130] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 00:09:06,268 WARN [Listener at jenkins-hbase4.apache.org/40445] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 00:09:06,323 INFO [Listener at jenkins-hbase4.apache.org/40445] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 00:09:06,429 WARN [BP-824911289-172.31.14.131-1689984374130 heartbeating to localhost/127.0.0.1:34573] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 00:09:06,429 WARN [BP-824911289-172.31.14.131-1689984374130 heartbeating to localhost/127.0.0.1:34573] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-824911289-172.31.14.131-1689984374130 (Datanode Uuid 48ce9b85-c313-4ad1-a1bc-570ffb0fb162) service to localhost/127.0.0.1:34573 2023-07-22 00:09:06,430 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/cluster_0032ba5a-a217-3173-3cbc-083e8f7fc05b/dfs/data/data3/current/BP-824911289-172.31.14.131-1689984374130] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 00:09:06,431 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/cluster_0032ba5a-a217-3173-3cbc-083e8f7fc05b/dfs/data/data4/current/BP-824911289-172.31.14.131-1689984374130] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 00:09:06,432 WARN [Listener at jenkins-hbase4.apache.org/40445] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-22 00:09:06,441 INFO [Listener at jenkins-hbase4.apache.org/40445] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 00:09:06,545 WARN [BP-824911289-172.31.14.131-1689984374130 heartbeating to localhost/127.0.0.1:34573] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-22 00:09:06,545 WARN [BP-824911289-172.31.14.131-1689984374130 heartbeating to localhost/127.0.0.1:34573] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-824911289-172.31.14.131-1689984374130 (Datanode Uuid a2dbf587-4819-4140-b54b-6eb143c0b9e6) service to localhost/127.0.0.1:34573 2023-07-22 00:09:06,545 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/cluster_0032ba5a-a217-3173-3cbc-083e8f7fc05b/dfs/data/data1/current/BP-824911289-172.31.14.131-1689984374130] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 00:09:06,546 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5324d09b-7ddb-f16d-1709-cf48b04f73e8/cluster_0032ba5a-a217-3173-3cbc-083e8f7fc05b/dfs/data/data2/current/BP-824911289-172.31.14.131-1689984374130] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-22 00:09:06,599 INFO [Listener at jenkins-hbase4.apache.org/40445] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-22 00:09:06,599 WARN [1131350025@qtp-237478628-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33797] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-22 00:09:06,599 WARN [1131350025@qtp-237478628-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33797] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-22 00:09:06,740 INFO [Listener at jenkins-hbase4.apache.org/40445] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-22 00:09:06,838 INFO [Listener at jenkins-hbase4.apache.org/40445] hbase.HBaseTestingUtility(1293): Minicluster is down