2023-09-24 13:00:20,956 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-24 13:00:21,174 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc 2023-09-24 13:00:21,174 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-24 13:00:21,175 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-24 13:00:21,217 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-24 13:00:21,440 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-24 13:00:21,441 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/cluster_ed01d86c-dd99-6983-78c4-e5333a88d982, deleteOnExit=true 2023-09-24 13:00:21,441 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-24 13:00:21,442 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/test.cache.data in system properties and HBase conf 2023-09-24 13:00:21,442 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop.tmp.dir in system properties and HBase conf 2023-09-24 13:00:21,442 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop.log.dir in system properties and HBase conf 2023-09-24 13:00:21,443 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-24 13:00:21,443 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-24 13:00:21,443 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-24 13:00:21,761 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-24 13:00:21,765 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-24 13:00:21,766 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-24 13:00:21,766 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-24 13:00:21,766 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-24 13:00:21,766 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-24 13:00:21,767 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-24 13:00:21,767 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-24 13:00:21,767 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-24 13:00:21,767 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-24 13:00:21,768 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/nfs.dump.dir in system properties and HBase conf 2023-09-24 13:00:21,768 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/java.io.tmpdir in system properties and HBase conf 2023-09-24 13:00:21,768 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-24 13:00:21,768 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-24 13:00:21,769 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-24 13:00:22,274 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-24 13:00:22,279 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-24 13:00:22,579 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-24 13:00:22,773 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-24 13:00:22,786 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 13:00:22,827 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 13:00:22,865 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/java.io.tmpdir/Jetty_localhost_46781_hdfs____6jao2g/webapp 2023-09-24 13:00:23,018 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46781 2023-09-24 13:00:23,059 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-24 13:00:23,059 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-24 13:00:23,557 WARN [Listener at localhost/36659] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-24 13:00:23,629 WARN [Listener at localhost/36659] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-24 13:00:23,648 WARN [Listener at localhost/36659] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 13:00:23,657 INFO [Listener at localhost/36659] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 13:00:23,666 INFO [Listener at localhost/36659] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/java.io.tmpdir/Jetty_localhost_40725_datanode____4mac9x/webapp 2023-09-24 13:00:23,763 INFO [Listener at localhost/36659] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40725 2023-09-24 13:00:24,207 WARN [Listener at localhost/37609] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-24 13:00:24,221 WARN [Listener at localhost/37609] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-24 13:00:24,224 WARN [Listener at localhost/37609] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 13:00:24,226 INFO [Listener at localhost/37609] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 13:00:24,235 INFO [Listener at localhost/37609] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/java.io.tmpdir/Jetty_localhost_36885_datanode____.mmi147/webapp 2023-09-24 13:00:24,335 INFO [Listener at localhost/37609] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36885 2023-09-24 13:00:24,345 WARN [Listener at localhost/43937] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-24 13:00:24,365 WARN [Listener at localhost/43937] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-24 13:00:24,368 WARN [Listener at localhost/43937] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 13:00:24,370 INFO [Listener at localhost/43937] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 13:00:24,378 INFO [Listener at localhost/43937] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/java.io.tmpdir/Jetty_localhost_42297_datanode____7xkpkp/webapp 2023-09-24 13:00:24,505 INFO [Listener at localhost/43937] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42297 2023-09-24 13:00:24,515 WARN [Listener at localhost/44849] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-24 13:00:24,806 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfdc31f228e5f576d: Processing first storage report for DS-ae2e427d-79eb-46d1-a99d-d7603ea4cabe from datanode 670e5384-15e1-47d8-9de0-cd48936cee08 2023-09-24 13:00:24,808 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfdc31f228e5f576d: from storage DS-ae2e427d-79eb-46d1-a99d-d7603ea4cabe node DatanodeRegistration(127.0.0.1:38035, datanodeUuid=670e5384-15e1-47d8-9de0-cd48936cee08, infoPort=44291, infoSecurePort=0, ipcPort=44849, storageInfo=lv=-57;cid=testClusterID;nsid=1971931598;c=1695560422359), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-24 13:00:24,808 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf89f85354f8e335a: Processing first storage report for DS-cc899748-9a2d-45bc-b281-0b6dd1d6e876 from datanode 81b0b54f-63d1-440f-a356-81de79fb4095 2023-09-24 13:00:24,808 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf89f85354f8e335a: from storage DS-cc899748-9a2d-45bc-b281-0b6dd1d6e876 node DatanodeRegistration(127.0.0.1:41173, datanodeUuid=81b0b54f-63d1-440f-a356-81de79fb4095, infoPort=35851, infoSecurePort=0, ipcPort=37609, storageInfo=lv=-57;cid=testClusterID;nsid=1971931598;c=1695560422359), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-24 13:00:24,808 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4a43204cb72428f9: Processing first storage report for DS-218a9dfa-1e5d-4c33-adff-ac88e47eff87 from datanode ce33b143-fe0c-42cf-9daf-1f1127f2d273 2023-09-24 13:00:24,808 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4a43204cb72428f9: from storage DS-218a9dfa-1e5d-4c33-adff-ac88e47eff87 node DatanodeRegistration(127.0.0.1:45287, datanodeUuid=ce33b143-fe0c-42cf-9daf-1f1127f2d273, infoPort=35251, infoSecurePort=0, ipcPort=43937, storageInfo=lv=-57;cid=testClusterID;nsid=1971931598;c=1695560422359), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-24 13:00:24,808 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfdc31f228e5f576d: Processing first storage report for DS-eea95b93-7709-422b-a8bf-37767fce7a33 from datanode 670e5384-15e1-47d8-9de0-cd48936cee08 2023-09-24 13:00:24,809 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfdc31f228e5f576d: from storage DS-eea95b93-7709-422b-a8bf-37767fce7a33 node DatanodeRegistration(127.0.0.1:38035, datanodeUuid=670e5384-15e1-47d8-9de0-cd48936cee08, infoPort=44291, infoSecurePort=0, ipcPort=44849, storageInfo=lv=-57;cid=testClusterID;nsid=1971931598;c=1695560422359), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-24 13:00:24,809 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf89f85354f8e335a: Processing first storage report for DS-e4bda888-f98e-4d79-92ee-7a079e8fab85 from datanode 81b0b54f-63d1-440f-a356-81de79fb4095 2023-09-24 13:00:24,809 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf89f85354f8e335a: from storage DS-e4bda888-f98e-4d79-92ee-7a079e8fab85 node DatanodeRegistration(127.0.0.1:41173, datanodeUuid=81b0b54f-63d1-440f-a356-81de79fb4095, infoPort=35851, infoSecurePort=0, ipcPort=37609, storageInfo=lv=-57;cid=testClusterID;nsid=1971931598;c=1695560422359), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-24 13:00:24,809 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4a43204cb72428f9: Processing first storage report for DS-5c6d7c8f-2302-44b1-92d3-157e93c4f1c6 from datanode ce33b143-fe0c-42cf-9daf-1f1127f2d273 2023-09-24 13:00:24,809 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4a43204cb72428f9: from storage DS-5c6d7c8f-2302-44b1-92d3-157e93c4f1c6 node DatanodeRegistration(127.0.0.1:45287, datanodeUuid=ce33b143-fe0c-42cf-9daf-1f1127f2d273, infoPort=35251, infoSecurePort=0, ipcPort=43937, storageInfo=lv=-57;cid=testClusterID;nsid=1971931598;c=1695560422359), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-24 13:00:25,009 DEBUG [Listener at localhost/44849] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc 2023-09-24 13:00:25,098 INFO [Listener at localhost/44849] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/cluster_ed01d86c-dd99-6983-78c4-e5333a88d982/zookeeper_0, clientPort=55856, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/cluster_ed01d86c-dd99-6983-78c4-e5333a88d982/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/cluster_ed01d86c-dd99-6983-78c4-e5333a88d982/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-24 13:00:25,115 INFO [Listener at localhost/44849] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55856 2023-09-24 13:00:25,123 INFO [Listener at localhost/44849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 13:00:25,125 INFO [Listener at localhost/44849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 13:00:25,810 INFO [Listener at localhost/44849] util.FSUtils(471): Created version file at hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 with version=8 2023-09-24 13:00:25,811 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/hbase-staging 2023-09-24 13:00:26,165 INFO [Listener at localhost/44849] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-24 13:00:26,617 INFO [Listener at localhost/44849] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-24 13:00:26,650 INFO [Listener at localhost/44849] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 13:00:26,650 INFO [Listener at localhost/44849] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-24 13:00:26,650 INFO [Listener at localhost/44849] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-24 13:00:26,651 INFO [Listener at localhost/44849] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 13:00:26,651 INFO [Listener at localhost/44849] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-24 13:00:26,792 INFO [Listener at localhost/44849] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-24 13:00:26,871 DEBUG [Listener at localhost/44849] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-24 13:00:26,966 INFO [Listener at localhost/44849] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39481 2023-09-24 13:00:26,979 INFO [Listener at localhost/44849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 13:00:26,981 INFO [Listener at localhost/44849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 13:00:27,004 INFO [Listener at localhost/44849] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39481 connecting to ZooKeeper ensemble=127.0.0.1:55856 2023-09-24 13:00:27,063 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:394810x0, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-24 13:00:27,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39481-0x100de06161b0000 connected 2023-09-24 13:00:27,095 DEBUG [Listener at localhost/44849] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-24 13:00:27,096 DEBUG [Listener at localhost/44849] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 13:00:27,108 DEBUG [Listener at localhost/44849] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-24 13:00:27,116 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39481 2023-09-24 13:00:27,117 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39481 2023-09-24 13:00:27,121 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39481 2023-09-24 13:00:27,121 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39481 2023-09-24 13:00:27,122 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39481 2023-09-24 13:00:27,130 INFO [Listener at localhost/44849] master.HMaster(444): hbase.rootdir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68, hbase.cluster.distributed=false 2023-09-24 13:00:27,221 INFO [Listener at localhost/44849] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-24 13:00:27,222 INFO [Listener at localhost/44849] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 13:00:27,222 INFO [Listener at localhost/44849] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-24 13:00:27,222 INFO [Listener at localhost/44849] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-24 13:00:27,223 INFO [Listener at localhost/44849] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 13:00:27,223 INFO [Listener at localhost/44849] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-24 13:00:27,230 INFO [Listener at localhost/44849] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-24 13:00:27,234 INFO [Listener at localhost/44849] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40801 2023-09-24 13:00:27,237 INFO [Listener at localhost/44849] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-24 13:00:27,246 INFO [Listener at localhost/44849] mob.MobFileCache(124): MobFileCache disabled 2023-09-24 13:00:27,248 INFO [Listener at localhost/44849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 13:00:27,250 INFO [Listener at localhost/44849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 13:00:27,253 INFO [Listener at localhost/44849] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40801 connecting to ZooKeeper ensemble=127.0.0.1:55856 2023-09-24 13:00:27,257 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:408010x0, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-24 13:00:27,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40801-0x100de06161b0001 connected 2023-09-24 13:00:27,258 DEBUG [Listener at localhost/44849] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-24 13:00:27,260 DEBUG [Listener at localhost/44849] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 13:00:27,261 DEBUG [Listener at localhost/44849] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-24 13:00:27,261 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40801 2023-09-24 13:00:27,261 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40801 2023-09-24 13:00:27,262 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40801 2023-09-24 13:00:27,262 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40801 2023-09-24 13:00:27,264 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40801 2023-09-24 13:00:27,276 INFO [Listener at localhost/44849] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-24 13:00:27,277 INFO [Listener at localhost/44849] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 13:00:27,277 INFO [Listener at localhost/44849] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-24 13:00:27,277 INFO [Listener at localhost/44849] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-24 13:00:27,278 INFO [Listener at localhost/44849] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 13:00:27,278 INFO [Listener at localhost/44849] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-24 13:00:27,278 INFO [Listener at localhost/44849] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-24 13:00:27,282 INFO [Listener at localhost/44849] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44885 2023-09-24 13:00:27,282 INFO [Listener at localhost/44849] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-24 13:00:27,283 INFO [Listener at localhost/44849] mob.MobFileCache(124): MobFileCache disabled 2023-09-24 13:00:27,284 INFO [Listener at localhost/44849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 13:00:27,287 INFO [Listener at localhost/44849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 13:00:27,291 INFO [Listener at localhost/44849] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44885 connecting to ZooKeeper ensemble=127.0.0.1:55856 2023-09-24 13:00:27,294 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:448850x0, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-24 13:00:27,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44885-0x100de06161b0002 connected 2023-09-24 13:00:27,296 DEBUG [Listener at localhost/44849] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-24 13:00:27,296 DEBUG [Listener at localhost/44849] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 13:00:27,297 DEBUG [Listener at localhost/44849] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-24 13:00:27,301 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44885 2023-09-24 13:00:27,301 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44885 2023-09-24 13:00:27,302 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44885 2023-09-24 13:00:27,304 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44885 2023-09-24 13:00:27,305 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44885 2023-09-24 13:00:27,316 INFO [Listener at localhost/44849] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-24 13:00:27,317 INFO [Listener at localhost/44849] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 13:00:27,317 INFO [Listener at localhost/44849] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-24 13:00:27,317 INFO [Listener at localhost/44849] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-24 13:00:27,317 INFO [Listener at localhost/44849] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-24 13:00:27,317 INFO [Listener at localhost/44849] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-24 13:00:27,317 INFO [Listener at localhost/44849] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-24 13:00:27,319 INFO [Listener at localhost/44849] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35765 2023-09-24 13:00:27,319 INFO [Listener at localhost/44849] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-24 13:00:27,320 INFO [Listener at localhost/44849] mob.MobFileCache(124): MobFileCache disabled 2023-09-24 13:00:27,321 INFO [Listener at localhost/44849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 13:00:27,322 INFO [Listener at localhost/44849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 13:00:27,324 INFO [Listener at localhost/44849] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35765 connecting to ZooKeeper ensemble=127.0.0.1:55856 2023-09-24 13:00:27,328 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:357650x0, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-24 13:00:27,329 DEBUG [Listener at localhost/44849] zookeeper.ZKUtil(164): regionserver:357650x0, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-24 13:00:27,330 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35765-0x100de06161b0003 connected 2023-09-24 13:00:27,330 DEBUG [Listener at localhost/44849] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 13:00:27,331 DEBUG [Listener at localhost/44849] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-24 13:00:27,333 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35765 2023-09-24 13:00:27,333 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35765 2023-09-24 13:00:27,333 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35765 2023-09-24 13:00:27,337 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35765 2023-09-24 13:00:27,337 DEBUG [Listener at localhost/44849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35765 2023-09-24 13:00:27,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39481,1695560426000 2023-09-24 13:00:27,348 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-24 13:00:27,350 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39481,1695560426000 2023-09-24 13:00:27,369 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-24 13:00:27,369 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-24 13:00:27,369 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-24 13:00:27,369 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-24 13:00:27,369 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 13:00:27,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-24 13:00:27,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39481,1695560426000 from backup master directory 2023-09-24 13:00:27,373 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-24 13:00:27,378 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39481,1695560426000 2023-09-24 13:00:27,378 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-24 13:00:27,379 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-24 13:00:27,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39481,1695560426000 2023-09-24 13:00:27,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-24 13:00:27,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-24 13:00:27,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/hbase.id with ID: 352ccccb-18d0-4c3d-8292-4fee051e3118 2023-09-24 13:00:27,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-24 13:00:27,553 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 13:00:27,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x080c2d4e to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:00:27,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d41b3d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:00:27,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-24 13:00:27,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-24 13:00:27,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-24 13:00:27,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-24 13:00:27,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-24 13:00:27,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-24 13:00:27,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-24 13:00:27,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/MasterData/data/master/store-tmp 2023-09-24 13:00:27,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:00:27,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-24 13:00:27,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 13:00:27,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 13:00:27,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-24 13:00:27,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 13:00:27,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 13:00:27,768 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-24 13:00:27,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/MasterData/WALs/jenkins-hbase4.apache.org,39481,1695560426000 2023-09-24 13:00:27,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39481%2C1695560426000, suffix=, logDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/MasterData/WALs/jenkins-hbase4.apache.org,39481,1695560426000, archiveDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/MasterData/oldWALs, maxLogs=10 2023-09-24 13:00:27,858 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41173,DS-cc899748-9a2d-45bc-b281-0b6dd1d6e876,DISK] 2023-09-24 13:00:27,858 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38035,DS-ae2e427d-79eb-46d1-a99d-d7603ea4cabe,DISK] 2023-09-24 13:00:27,858 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45287,DS-218a9dfa-1e5d-4c33-adff-ac88e47eff87,DISK] 2023-09-24 13:00:27,867 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-24 13:00:27,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/MasterData/WALs/jenkins-hbase4.apache.org,39481,1695560426000/jenkins-hbase4.apache.org%2C39481%2C1695560426000.1695560427803 2023-09-24 13:00:27,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41173,DS-cc899748-9a2d-45bc-b281-0b6dd1d6e876,DISK], DatanodeInfoWithStorage[127.0.0.1:38035,DS-ae2e427d-79eb-46d1-a99d-d7603ea4cabe,DISK], DatanodeInfoWithStorage[127.0.0.1:45287,DS-218a9dfa-1e5d-4c33-adff-ac88e47eff87,DISK]] 2023-09-24 13:00:27,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-24 13:00:27,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:00:27,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-24 13:00:27,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-24 13:00:28,019 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-24 13:00:28,027 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-24 13:00:28,056 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-24 13:00:28,069 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:00:28,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-24 13:00:28,077 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-24 13:00:28,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-24 13:00:28,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:00:28,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69417701, jitterRate=0.03440435230731964}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:00:28,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-24 13:00:28,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-24 13:00:28,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-24 13:00:28,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-24 13:00:28,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-24 13:00:28,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-24 13:00:28,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-09-24 13:00:28,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-24 13:00:28,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-24 13:00:28,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-24 13:00:28,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-24 13:00:28,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-24 13:00:28,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-24 13:00:28,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-24 13:00:28,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-24 13:00:28,253 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 13:00:28,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-24 13:00:28,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-24 13:00:28,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-24 13:00:28,273 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-24 13:00:28,273 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-24 13:00:28,273 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 13:00:28,273 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-24 13:00:28,273 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-24 13:00:28,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,39481,1695560426000, sessionid=0x100de06161b0000, setting cluster-up flag (Was=false) 2023-09-24 13:00:28,293 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 13:00:28,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-24 13:00:28,302 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39481,1695560426000 2023-09-24 13:00:28,308 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 13:00:28,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-24 13:00:28,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39481,1695560426000 2023-09-24 13:00:28,318 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp 2023-09-24 13:00:28,341 INFO [RS:1;jenkins-hbase4:44885] regionserver.HRegionServer(951): ClusterId : 352ccccb-18d0-4c3d-8292-4fee051e3118 2023-09-24 13:00:28,341 INFO [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(951): ClusterId : 352ccccb-18d0-4c3d-8292-4fee051e3118 2023-09-24 13:00:28,342 INFO [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(951): ClusterId : 352ccccb-18d0-4c3d-8292-4fee051e3118 2023-09-24 13:00:28,349 DEBUG [RS:1;jenkins-hbase4:44885] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-24 13:00:28,349 DEBUG [RS:0;jenkins-hbase4:40801] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-24 13:00:28,349 DEBUG [RS:2;jenkins-hbase4:35765] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-24 13:00:28,356 DEBUG [RS:1;jenkins-hbase4:44885] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-24 13:00:28,356 DEBUG [RS:2;jenkins-hbase4:35765] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-24 13:00:28,356 DEBUG [RS:0;jenkins-hbase4:40801] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-24 13:00:28,357 DEBUG [RS:2;jenkins-hbase4:35765] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-24 13:00:28,356 DEBUG [RS:1;jenkins-hbase4:44885] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-24 13:00:28,357 DEBUG [RS:0;jenkins-hbase4:40801] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-24 13:00:28,362 DEBUG [RS:1;jenkins-hbase4:44885] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-24 13:00:28,362 DEBUG [RS:0;jenkins-hbase4:40801] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-24 13:00:28,362 DEBUG [RS:2;jenkins-hbase4:35765] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-24 13:00:28,366 DEBUG [RS:2;jenkins-hbase4:35765] zookeeper.ReadOnlyZKClient(139): Connect 0x501d889b to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:00:28,366 DEBUG [RS:1;jenkins-hbase4:44885] zookeeper.ReadOnlyZKClient(139): Connect 0x5e466c48 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:00:28,366 DEBUG [RS:0;jenkins-hbase4:40801] zookeeper.ReadOnlyZKClient(139): Connect 0x199fd150 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:00:28,378 DEBUG [RS:1;jenkins-hbase4:44885] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@508199f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:00:28,378 DEBUG [RS:0;jenkins-hbase4:40801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17582c13, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:00:28,378 DEBUG [RS:1;jenkins-hbase4:44885] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54be0738, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-24 13:00:28,378 DEBUG [RS:2;jenkins-hbase4:35765] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5eda6ce8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:00:28,379 DEBUG [RS:0;jenkins-hbase4:40801] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1367ba20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-24 13:00:28,379 DEBUG [RS:2;jenkins-hbase4:35765] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ae5e3eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-24 13:00:28,403 DEBUG [RS:0;jenkins-hbase4:40801] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40801 2023-09-24 13:00:28,406 DEBUG [RS:2;jenkins-hbase4:35765] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:35765 2023-09-24 13:00:28,407 DEBUG [RS:1;jenkins-hbase4:44885] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44885 2023-09-24 13:00:28,409 INFO [RS:0;jenkins-hbase4:40801] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-24 13:00:28,409 INFO [RS:2;jenkins-hbase4:35765] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-24 13:00:28,409 INFO [RS:1;jenkins-hbase4:44885] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-24 13:00:28,409 INFO [RS:2;jenkins-hbase4:35765] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-24 13:00:28,409 INFO [RS:0;jenkins-hbase4:40801] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-24 13:00:28,409 INFO [RS:1;jenkins-hbase4:44885] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-24 13:00:28,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-24 13:00:28,428 DEBUG [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-24 13:00:28,427 DEBUG [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-24 13:00:28,427 DEBUG [RS:1;jenkins-hbase4:44885] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-24 13:00:28,430 INFO [RS:2;jenkins-hbase4:35765] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:00:28,430 INFO [RS:1;jenkins-hbase4:44885] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:00:28,430 DEBUG [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(1022): About to register with Master. 2023-09-24 13:00:28,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:00:28,430 INFO [RS:0;jenkins-hbase4:40801] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:00:28,430 DEBUG [RS:1;jenkins-hbase4:44885] regionserver.HRegionServer(1022): About to register with Master. 2023-09-24 13:00:28,431 DEBUG [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(1022): About to register with Master. 2023-09-24 13:00:28,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-24 13:00:28,433 INFO [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39481,1695560426000 with isa=jenkins-hbase4.apache.org/172.31.14.131:35765, startcode=1695560427316 2023-09-24 13:00:28,433 INFO [RS:1;jenkins-hbase4:44885] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39481,1695560426000 with isa=jenkins-hbase4.apache.org/172.31.14.131:44885, startcode=1695560427276 2023-09-24 13:00:28,433 INFO [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39481,1695560426000 with isa=jenkins-hbase4.apache.org/172.31.14.131:40801, startcode=1695560427220 2023-09-24 13:00:28,457 DEBUG [RS:2;jenkins-hbase4:35765] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-24 13:00:28,457 DEBUG [RS:0;jenkins-hbase4:40801] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-24 13:00:28,457 DEBUG [RS:1;jenkins-hbase4:44885] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-24 13:00:28,542 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42133, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-24 13:00:28,542 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40411, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-24 13:00:28,542 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34835, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-24 13:00:28,552 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39481] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-24 13:00:28,554 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-24 13:00:28,561 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39481] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-24 13:00:28,562 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39481] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-24 13:00:28,566 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-24 13:00:28,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-24 13:00:28,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-24 13:00:28,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-24 13:00:28,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-24 13:00:28,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-24 13:00:28,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695560458569 2023-09-24 13:00:28,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-24 13:00:28,576 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-24 13:00:28,577 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-24 13:00:28,583 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-24 13:00:28,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-24 13:00:28,584 DEBUG [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(2830): Master is not running yet 2023-09-24 13:00:28,584 DEBUG [RS:1;jenkins-hbase4:44885] regionserver.HRegionServer(2830): Master is not running yet 2023-09-24 13:00:28,584 DEBUG [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(2830): Master is not running yet 2023-09-24 13:00:28,586 WARN [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-24 13:00:28,586 WARN [RS:1;jenkins-hbase4:44885] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-24 13:00:28,586 WARN [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-24 13:00:28,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-24 13:00:28,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-24 13:00:28,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-24 13:00:28,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-24 13:00:28,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-24 13:00:28,595 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-24 13:00:28,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-24 13:00:28,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-24 13:00:28,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-24 13:00:28,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695560428600,5,FailOnTimeoutGroup] 2023-09-24 13:00:28,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695560428600,5,FailOnTimeoutGroup] 2023-09-24 13:00:28,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-24 13:00:28,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,602 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,626 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-24 13:00:28,627 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-24 13:00:28,627 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:00:28,648 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:00:28,650 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-24 13:00:28,653 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/info 2023-09-24 13:00:28,653 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-24 13:00:28,654 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:00:28,655 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-24 13:00:28,657 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/rep_barrier 2023-09-24 13:00:28,658 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-24 13:00:28,659 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:00:28,659 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-24 13:00:28,661 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/table 2023-09-24 13:00:28,662 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-24 13:00:28,662 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:00:28,664 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740 2023-09-24 13:00:28,665 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740 2023-09-24 13:00:28,668 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-24 13:00:28,671 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-24 13:00:28,675 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:00:28,676 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60855845, jitterRate=-0.09317724406719208}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-24 13:00:28,676 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-24 13:00:28,676 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-24 13:00:28,677 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-24 13:00:28,677 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-24 13:00:28,677 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-24 13:00:28,677 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-24 13:00:28,679 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-24 13:00:28,679 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-24 13:00:28,686 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-24 13:00:28,686 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-24 13:00:28,687 INFO [RS:1;jenkins-hbase4:44885] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39481,1695560426000 with isa=jenkins-hbase4.apache.org/172.31.14.131:44885, startcode=1695560427276 2023-09-24 13:00:28,687 INFO [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39481,1695560426000 with isa=jenkins-hbase4.apache.org/172.31.14.131:40801, startcode=1695560427220 2023-09-24 13:00:28,687 INFO [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,39481,1695560426000 with isa=jenkins-hbase4.apache.org/172.31.14.131:35765, startcode=1695560427316 2023-09-24 13:00:28,694 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39481] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:28,702 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39481] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:28,702 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-24 13:00:28,703 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39481] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:28,704 DEBUG [RS:1;jenkins-hbase4:44885] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:00:28,705 DEBUG [RS:1;jenkins-hbase4:44885] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36659 2023-09-24 13:00:28,705 DEBUG [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:00:28,706 DEBUG [RS:1;jenkins-hbase4:44885] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-24 13:00:28,706 DEBUG [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:00:28,706 DEBUG [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36659 2023-09-24 13:00:28,706 DEBUG [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36659 2023-09-24 13:00:28,706 DEBUG [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-24 13:00:28,706 DEBUG [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-24 13:00:28,712 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 13:00:28,718 DEBUG [RS:2;jenkins-hbase4:35765] zookeeper.ZKUtil(162): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:28,718 WARN [RS:2;jenkins-hbase4:35765] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-24 13:00:28,718 INFO [RS:2;jenkins-hbase4:35765] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-24 13:00:28,718 DEBUG [RS:1;jenkins-hbase4:44885] zookeeper.ZKUtil(162): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:28,718 DEBUG [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/WALs/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:28,719 DEBUG [RS:0;jenkins-hbase4:40801] zookeeper.ZKUtil(162): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:28,718 WARN [RS:1;jenkins-hbase4:44885] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-24 13:00:28,719 WARN [RS:0;jenkins-hbase4:40801] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-24 13:00:28,719 INFO [RS:1;jenkins-hbase4:44885] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-24 13:00:28,719 INFO [RS:0;jenkins-hbase4:40801] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-24 13:00:28,720 DEBUG [RS:1;jenkins-hbase4:44885] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/WALs/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:28,720 DEBUG [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/WALs/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:28,719 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44885,1695560427276] 2023-09-24 13:00:28,720 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-24 13:00:28,722 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35765,1695560427316] 2023-09-24 13:00:28,722 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40801,1695560427220] 2023-09-24 13:00:28,727 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-24 13:00:28,736 DEBUG [RS:0;jenkins-hbase4:40801] zookeeper.ZKUtil(162): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:28,736 DEBUG [RS:2;jenkins-hbase4:35765] zookeeper.ZKUtil(162): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:28,736 DEBUG [RS:1;jenkins-hbase4:44885] zookeeper.ZKUtil(162): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:28,737 DEBUG [RS:0;jenkins-hbase4:40801] zookeeper.ZKUtil(162): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:28,737 DEBUG [RS:2;jenkins-hbase4:35765] zookeeper.ZKUtil(162): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:28,737 DEBUG [RS:1;jenkins-hbase4:44885] zookeeper.ZKUtil(162): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:28,737 DEBUG [RS:0;jenkins-hbase4:40801] zookeeper.ZKUtil(162): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:28,737 DEBUG [RS:2;jenkins-hbase4:35765] zookeeper.ZKUtil(162): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:28,737 DEBUG [RS:1;jenkins-hbase4:44885] zookeeper.ZKUtil(162): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:28,755 DEBUG [RS:1;jenkins-hbase4:44885] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-24 13:00:28,755 DEBUG [RS:2;jenkins-hbase4:35765] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-24 13:00:28,755 DEBUG [RS:0;jenkins-hbase4:40801] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-24 13:00:28,766 INFO [RS:1;jenkins-hbase4:44885] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-24 13:00:28,767 INFO [RS:0;jenkins-hbase4:40801] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-24 13:00:28,766 INFO [RS:2;jenkins-hbase4:35765] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-24 13:00:28,792 INFO [RS:0;jenkins-hbase4:40801] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-24 13:00:28,792 INFO [RS:1;jenkins-hbase4:44885] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-24 13:00:28,792 INFO [RS:2;jenkins-hbase4:35765] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-24 13:00:28,797 INFO [RS:0;jenkins-hbase4:40801] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-24 13:00:28,797 INFO [RS:2;jenkins-hbase4:35765] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-24 13:00:28,797 INFO [RS:0;jenkins-hbase4:40801] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,797 INFO [RS:1;jenkins-hbase4:44885] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-24 13:00:28,798 INFO [RS:2;jenkins-hbase4:35765] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,798 INFO [RS:1;jenkins-hbase4:44885] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,798 INFO [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-24 13:00:28,799 INFO [RS:1;jenkins-hbase4:44885] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-24 13:00:28,798 INFO [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-24 13:00:28,808 INFO [RS:1;jenkins-hbase4:44885] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,808 INFO [RS:0;jenkins-hbase4:40801] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,808 INFO [RS:2;jenkins-hbase4:35765] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,808 DEBUG [RS:1;jenkins-hbase4:44885] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,808 DEBUG [RS:0;jenkins-hbase4:40801] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,809 DEBUG [RS:1;jenkins-hbase4:44885] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,809 DEBUG [RS:0;jenkins-hbase4:40801] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,809 DEBUG [RS:1;jenkins-hbase4:44885] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,809 DEBUG [RS:0;jenkins-hbase4:40801] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,809 DEBUG [RS:2;jenkins-hbase4:35765] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,809 DEBUG [RS:0;jenkins-hbase4:40801] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,809 DEBUG [RS:1;jenkins-hbase4:44885] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,809 DEBUG [RS:0;jenkins-hbase4:40801] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,809 DEBUG [RS:2;jenkins-hbase4:35765] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,809 DEBUG [RS:0;jenkins-hbase4:40801] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-24 13:00:28,809 DEBUG [RS:1;jenkins-hbase4:44885] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,809 DEBUG [RS:0;jenkins-hbase4:40801] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,809 DEBUG [RS:2;jenkins-hbase4:35765] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,810 DEBUG [RS:0;jenkins-hbase4:40801] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,810 DEBUG [RS:2;jenkins-hbase4:35765] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,810 DEBUG [RS:0;jenkins-hbase4:40801] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,810 DEBUG [RS:2;jenkins-hbase4:35765] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,810 DEBUG [RS:0;jenkins-hbase4:40801] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,810 DEBUG [RS:2;jenkins-hbase4:35765] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-24 13:00:28,810 DEBUG [RS:1;jenkins-hbase4:44885] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-24 13:00:28,810 DEBUG [RS:2;jenkins-hbase4:35765] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,810 DEBUG [RS:1;jenkins-hbase4:44885] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,811 DEBUG [RS:2;jenkins-hbase4:35765] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,811 DEBUG [RS:1;jenkins-hbase4:44885] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,811 DEBUG [RS:2;jenkins-hbase4:35765] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,811 DEBUG [RS:1;jenkins-hbase4:44885] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,811 DEBUG [RS:2;jenkins-hbase4:35765] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,811 DEBUG [RS:1;jenkins-hbase4:44885] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-24 13:00:28,811 INFO [RS:0;jenkins-hbase4:40801] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,812 INFO [RS:0;jenkins-hbase4:40801] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,812 INFO [RS:0;jenkins-hbase4:40801] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,812 INFO [RS:2;jenkins-hbase4:35765] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,812 INFO [RS:2;jenkins-hbase4:35765] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,812 INFO [RS:2;jenkins-hbase4:35765] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,818 INFO [RS:1;jenkins-hbase4:44885] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,818 INFO [RS:1;jenkins-hbase4:44885] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,819 INFO [RS:1;jenkins-hbase4:44885] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,832 INFO [RS:2;jenkins-hbase4:35765] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-24 13:00:28,833 INFO [RS:1;jenkins-hbase4:44885] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-24 13:00:28,836 INFO [RS:0;jenkins-hbase4:40801] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-24 13:00:28,837 INFO [RS:1;jenkins-hbase4:44885] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44885,1695560427276-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,837 INFO [RS:2;jenkins-hbase4:35765] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35765,1695560427316-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,837 INFO [RS:0;jenkins-hbase4:40801] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40801,1695560427220-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:28,869 INFO [RS:1;jenkins-hbase4:44885] regionserver.Replication(203): jenkins-hbase4.apache.org,44885,1695560427276 started 2023-09-24 13:00:28,869 INFO [RS:1;jenkins-hbase4:44885] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,44885,1695560427276, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44885, sessionid=0x100de06161b0002 2023-09-24 13:00:28,869 DEBUG [RS:1;jenkins-hbase4:44885] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-24 13:00:28,869 DEBUG [RS:1;jenkins-hbase4:44885] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:28,870 DEBUG [RS:1;jenkins-hbase4:44885] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44885,1695560427276' 2023-09-24 13:00:28,870 DEBUG [RS:1;jenkins-hbase4:44885] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-24 13:00:28,870 DEBUG [RS:1;jenkins-hbase4:44885] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-24 13:00:28,871 DEBUG [RS:1;jenkins-hbase4:44885] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-24 13:00:28,871 DEBUG [RS:1;jenkins-hbase4:44885] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-24 13:00:28,871 DEBUG [RS:1;jenkins-hbase4:44885] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:28,871 DEBUG [RS:1;jenkins-hbase4:44885] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44885,1695560427276' 2023-09-24 13:00:28,871 DEBUG [RS:1;jenkins-hbase4:44885] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:28,871 INFO [RS:0;jenkins-hbase4:40801] regionserver.Replication(203): jenkins-hbase4.apache.org,40801,1695560427220 started 2023-09-24 13:00:28,871 INFO [RS:2;jenkins-hbase4:35765] regionserver.Replication(203): jenkins-hbase4.apache.org,35765,1695560427316 started 2023-09-24 13:00:28,872 INFO [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40801,1695560427220, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40801, sessionid=0x100de06161b0001 2023-09-24 13:00:28,872 INFO [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35765,1695560427316, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35765, sessionid=0x100de06161b0003 2023-09-24 13:00:28,872 DEBUG [RS:0;jenkins-hbase4:40801] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-24 13:00:28,872 DEBUG [RS:2;jenkins-hbase4:35765] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-24 13:00:28,872 DEBUG [RS:1;jenkins-hbase4:44885] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:28,873 DEBUG [RS:2;jenkins-hbase4:35765] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:28,872 DEBUG [RS:0;jenkins-hbase4:40801] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:28,873 DEBUG [RS:2;jenkins-hbase4:35765] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35765,1695560427316' 2023-09-24 13:00:28,873 DEBUG [RS:0;jenkins-hbase4:40801] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40801,1695560427220' 2023-09-24 13:00:28,873 DEBUG [RS:2;jenkins-hbase4:35765] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-24 13:00:28,874 DEBUG [RS:0;jenkins-hbase4:40801] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-24 13:00:28,874 DEBUG [RS:1;jenkins-hbase4:44885] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-24 13:00:28,874 INFO [RS:1;jenkins-hbase4:44885] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-24 13:00:28,874 INFO [RS:1;jenkins-hbase4:44885] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-24 13:00:28,874 DEBUG [RS:2;jenkins-hbase4:35765] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-24 13:00:28,875 DEBUG [RS:2;jenkins-hbase4:35765] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-24 13:00:28,875 DEBUG [RS:2;jenkins-hbase4:35765] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-24 13:00:28,875 DEBUG [RS:2;jenkins-hbase4:35765] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:28,876 DEBUG [RS:2;jenkins-hbase4:35765] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35765,1695560427316' 2023-09-24 13:00:28,876 DEBUG [RS:2;jenkins-hbase4:35765] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:28,876 DEBUG [RS:0;jenkins-hbase4:40801] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-24 13:00:28,876 DEBUG [RS:2;jenkins-hbase4:35765] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:28,876 DEBUG [RS:0;jenkins-hbase4:40801] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-24 13:00:28,877 DEBUG [RS:0;jenkins-hbase4:40801] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-24 13:00:28,877 DEBUG [RS:0;jenkins-hbase4:40801] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:28,877 DEBUG [RS:2;jenkins-hbase4:35765] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-24 13:00:28,877 DEBUG [RS:0;jenkins-hbase4:40801] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40801,1695560427220' 2023-09-24 13:00:28,878 DEBUG [RS:0;jenkins-hbase4:40801] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:28,877 INFO [RS:2;jenkins-hbase4:35765] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-24 13:00:28,878 INFO [RS:2;jenkins-hbase4:35765] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-24 13:00:28,879 DEBUG [RS:0;jenkins-hbase4:40801] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:28,879 DEBUG [RS:0;jenkins-hbase4:40801] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-24 13:00:28,880 INFO [RS:0;jenkins-hbase4:40801] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-24 13:00:28,880 INFO [RS:0;jenkins-hbase4:40801] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-24 13:00:28,880 DEBUG [jenkins-hbase4:39481] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-24 13:00:28,884 DEBUG [jenkins-hbase4:39481] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 13:00:28,890 DEBUG [jenkins-hbase4:39481] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 13:00:28,890 DEBUG [jenkins-hbase4:39481] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 13:00:28,890 DEBUG [jenkins-hbase4:39481] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 13:00:28,890 DEBUG [jenkins-hbase4:39481] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 13:00:28,893 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40801,1695560427220, state=OPENING 2023-09-24 13:00:28,901 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-24 13:00:28,902 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 13:00:28,903 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-24 13:00:28,907 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40801,1695560427220}] 2023-09-24 13:00:28,986 INFO [RS:1;jenkins-hbase4:44885] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44885%2C1695560427276, suffix=, logDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/WALs/jenkins-hbase4.apache.org,44885,1695560427276, archiveDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/oldWALs, maxLogs=32 2023-09-24 13:00:28,986 INFO [RS:0;jenkins-hbase4:40801] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40801%2C1695560427220, suffix=, logDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/WALs/jenkins-hbase4.apache.org,40801,1695560427220, archiveDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/oldWALs, maxLogs=32 2023-09-24 13:00:28,986 INFO [RS:2;jenkins-hbase4:35765] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35765%2C1695560427316, suffix=, logDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/WALs/jenkins-hbase4.apache.org,35765,1695560427316, archiveDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/oldWALs, maxLogs=32 2023-09-24 13:00:29,044 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38035,DS-ae2e427d-79eb-46d1-a99d-d7603ea4cabe,DISK] 2023-09-24 13:00:29,044 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45287,DS-218a9dfa-1e5d-4c33-adff-ac88e47eff87,DISK] 2023-09-24 13:00:29,045 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45287,DS-218a9dfa-1e5d-4c33-adff-ac88e47eff87,DISK] 2023-09-24 13:00:29,045 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41173,DS-cc899748-9a2d-45bc-b281-0b6dd1d6e876,DISK] 2023-09-24 13:00:29,045 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38035,DS-ae2e427d-79eb-46d1-a99d-d7603ea4cabe,DISK] 2023-09-24 13:00:29,053 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41173,DS-cc899748-9a2d-45bc-b281-0b6dd1d6e876,DISK] 2023-09-24 13:00:29,054 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41173,DS-cc899748-9a2d-45bc-b281-0b6dd1d6e876,DISK] 2023-09-24 13:00:29,054 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45287,DS-218a9dfa-1e5d-4c33-adff-ac88e47eff87,DISK] 2023-09-24 13:00:29,054 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38035,DS-ae2e427d-79eb-46d1-a99d-d7603ea4cabe,DISK] 2023-09-24 13:00:29,062 INFO [RS:2;jenkins-hbase4:35765] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/WALs/jenkins-hbase4.apache.org,35765,1695560427316/jenkins-hbase4.apache.org%2C35765%2C1695560427316.1695560428991 2023-09-24 13:00:29,064 INFO [RS:1;jenkins-hbase4:44885] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/WALs/jenkins-hbase4.apache.org,44885,1695560427276/jenkins-hbase4.apache.org%2C44885%2C1695560427276.1695560428991 2023-09-24 13:00:29,065 DEBUG [RS:2;jenkins-hbase4:35765] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38035,DS-ae2e427d-79eb-46d1-a99d-d7603ea4cabe,DISK], DatanodeInfoWithStorage[127.0.0.1:45287,DS-218a9dfa-1e5d-4c33-adff-ac88e47eff87,DISK], DatanodeInfoWithStorage[127.0.0.1:41173,DS-cc899748-9a2d-45bc-b281-0b6dd1d6e876,DISK]] 2023-09-24 13:00:29,066 DEBUG [RS:1;jenkins-hbase4:44885] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41173,DS-cc899748-9a2d-45bc-b281-0b6dd1d6e876,DISK], DatanodeInfoWithStorage[127.0.0.1:38035,DS-ae2e427d-79eb-46d1-a99d-d7603ea4cabe,DISK], DatanodeInfoWithStorage[127.0.0.1:45287,DS-218a9dfa-1e5d-4c33-adff-ac88e47eff87,DISK]] 2023-09-24 13:00:29,066 INFO [RS:0;jenkins-hbase4:40801] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/WALs/jenkins-hbase4.apache.org,40801,1695560427220/jenkins-hbase4.apache.org%2C40801%2C1695560427220.1695560428991 2023-09-24 13:00:29,067 DEBUG [RS:0;jenkins-hbase4:40801] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38035,DS-ae2e427d-79eb-46d1-a99d-d7603ea4cabe,DISK], DatanodeInfoWithStorage[127.0.0.1:45287,DS-218a9dfa-1e5d-4c33-adff-ac88e47eff87,DISK], DatanodeInfoWithStorage[127.0.0.1:41173,DS-cc899748-9a2d-45bc-b281-0b6dd1d6e876,DISK]] 2023-09-24 13:00:29,094 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:29,096 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 13:00:29,098 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 13:00:29,109 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-24 13:00:29,110 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-24 13:00:29,113 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40801%2C1695560427220.meta, suffix=.meta, logDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/WALs/jenkins-hbase4.apache.org,40801,1695560427220, archiveDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/oldWALs, maxLogs=32 2023-09-24 13:00:29,131 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41173,DS-cc899748-9a2d-45bc-b281-0b6dd1d6e876,DISK] 2023-09-24 13:00:29,131 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38035,DS-ae2e427d-79eb-46d1-a99d-d7603ea4cabe,DISK] 2023-09-24 13:00:29,134 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45287,DS-218a9dfa-1e5d-4c33-adff-ac88e47eff87,DISK] 2023-09-24 13:00:29,139 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/WALs/jenkins-hbase4.apache.org,40801,1695560427220/jenkins-hbase4.apache.org%2C40801%2C1695560427220.meta.1695560429114.meta 2023-09-24 13:00:29,142 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38035,DS-ae2e427d-79eb-46d1-a99d-d7603ea4cabe,DISK], DatanodeInfoWithStorage[127.0.0.1:41173,DS-cc899748-9a2d-45bc-b281-0b6dd1d6e876,DISK], DatanodeInfoWithStorage[127.0.0.1:45287,DS-218a9dfa-1e5d-4c33-adff-ac88e47eff87,DISK]] 2023-09-24 13:00:29,142 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-24 13:00:29,143 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-24 13:00:29,145 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:00:29,145 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-24 13:00:29,147 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-24 13:00:29,149 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-24 13:00:29,162 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-24 13:00:29,162 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:00:29,162 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-24 13:00:29,162 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-24 13:00:29,165 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-24 13:00:29,166 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/info 2023-09-24 13:00:29,166 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/info 2023-09-24 13:00:29,167 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-24 13:00:29,168 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:00:29,168 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-24 13:00:29,169 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/rep_barrier 2023-09-24 13:00:29,170 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/rep_barrier 2023-09-24 13:00:29,170 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-24 13:00:29,171 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:00:29,171 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-24 13:00:29,173 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/table 2023-09-24 13:00:29,173 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/table 2023-09-24 13:00:29,173 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-24 13:00:29,174 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:00:29,175 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740 2023-09-24 13:00:29,178 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740 2023-09-24 13:00:29,181 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-24 13:00:29,184 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-24 13:00:29,185 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71270467, jitterRate=0.06201271712779999}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-24 13:00:29,188 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-24 13:00:29,199 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695560429084 2023-09-24 13:00:29,216 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-24 13:00:29,217 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-24 13:00:29,217 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40801,1695560427220, state=OPEN 2023-09-24 13:00:29,220 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-24 13:00:29,221 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-24 13:00:29,225 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-24 13:00:29,225 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40801,1695560427220 in 314 msec 2023-09-24 13:00:29,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-24 13:00:29,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 524 msec 2023-09-24 13:00:29,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 795 msec 2023-09-24 13:00:29,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695560429237, completionTime=-1 2023-09-24 13:00:29,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-24 13:00:29,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-24 13:00:29,316 DEBUG [hconnection-0x1ab56501-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:29,319 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:29,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-24 13:00:29,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695560489346 2023-09-24 13:00:29,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695560549346 2023-09-24 13:00:29,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 108 msec 2023-09-24 13:00:29,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39481,1695560426000-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:29,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39481,1695560426000-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:29,371 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39481,1695560426000-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:29,373 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39481, period=300000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:29,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-24 13:00:29,383 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-24 13:00:29,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-24 13:00:29,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-24 13:00:29,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-24 13:00:29,407 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 13:00:29,410 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 13:00:29,438 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/hbase/namespace/b25ff627188d3ff231a5dedf1236ac28 2023-09-24 13:00:29,441 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/hbase/namespace/b25ff627188d3ff231a5dedf1236ac28 empty. 2023-09-24 13:00:29,441 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/hbase/namespace/b25ff627188d3ff231a5dedf1236ac28 2023-09-24 13:00:29,441 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-24 13:00:29,476 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-24 13:00:29,478 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => b25ff627188d3ff231a5dedf1236ac28, NAME => 'hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp 2023-09-24 13:00:29,505 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:00:29,505 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing b25ff627188d3ff231a5dedf1236ac28, disabling compactions & flushes 2023-09-24 13:00:29,505 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28. 2023-09-24 13:00:29,505 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28. 2023-09-24 13:00:29,505 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28. after waiting 0 ms 2023-09-24 13:00:29,505 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28. 2023-09-24 13:00:29,505 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28. 2023-09-24 13:00:29,505 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for b25ff627188d3ff231a5dedf1236ac28: 2023-09-24 13:00:29,510 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 13:00:29,525 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695560429512"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560429512"}]},"ts":"1695560429512"} 2023-09-24 13:00:29,551 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-24 13:00:29,553 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 13:00:29,558 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560429554"}]},"ts":"1695560429554"} 2023-09-24 13:00:29,561 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-24 13:00:29,565 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 13:00:29,566 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 13:00:29,566 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 13:00:29,567 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 13:00:29,567 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 13:00:29,569 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b25ff627188d3ff231a5dedf1236ac28, ASSIGN}] 2023-09-24 13:00:29,571 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=b25ff627188d3ff231a5dedf1236ac28, ASSIGN 2023-09-24 13:00:29,573 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=b25ff627188d3ff231a5dedf1236ac28, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35765,1695560427316; forceNewPlan=false, retain=false 2023-09-24 13:00:29,725 INFO [jenkins-hbase4:39481] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-24 13:00:29,726 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b25ff627188d3ff231a5dedf1236ac28, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:29,727 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695560429726"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560429726"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560429726"}]},"ts":"1695560429726"} 2023-09-24 13:00:29,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure b25ff627188d3ff231a5dedf1236ac28, server=jenkins-hbase4.apache.org,35765,1695560427316}] 2023-09-24 13:00:29,887 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:29,887 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 13:00:29,891 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 13:00:29,897 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28. 2023-09-24 13:00:29,899 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b25ff627188d3ff231a5dedf1236ac28, NAME => 'hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28.', STARTKEY => '', ENDKEY => ''} 2023-09-24 13:00:29,899 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28. service=AccessControlService 2023-09-24 13:00:29,900 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:00:29,901 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace b25ff627188d3ff231a5dedf1236ac28 2023-09-24 13:00:29,901 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:00:29,901 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b25ff627188d3ff231a5dedf1236ac28 2023-09-24 13:00:29,901 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b25ff627188d3ff231a5dedf1236ac28 2023-09-24 13:00:29,903 INFO [StoreOpener-b25ff627188d3ff231a5dedf1236ac28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region b25ff627188d3ff231a5dedf1236ac28 2023-09-24 13:00:29,905 DEBUG [StoreOpener-b25ff627188d3ff231a5dedf1236ac28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/namespace/b25ff627188d3ff231a5dedf1236ac28/info 2023-09-24 13:00:29,906 DEBUG [StoreOpener-b25ff627188d3ff231a5dedf1236ac28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/namespace/b25ff627188d3ff231a5dedf1236ac28/info 2023-09-24 13:00:29,906 INFO [StoreOpener-b25ff627188d3ff231a5dedf1236ac28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b25ff627188d3ff231a5dedf1236ac28 columnFamilyName info 2023-09-24 13:00:29,907 INFO [StoreOpener-b25ff627188d3ff231a5dedf1236ac28-1] regionserver.HStore(310): Store=b25ff627188d3ff231a5dedf1236ac28/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:00:29,908 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/namespace/b25ff627188d3ff231a5dedf1236ac28 2023-09-24 13:00:29,909 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/namespace/b25ff627188d3ff231a5dedf1236ac28 2023-09-24 13:00:29,914 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b25ff627188d3ff231a5dedf1236ac28 2023-09-24 13:00:29,918 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/namespace/b25ff627188d3ff231a5dedf1236ac28/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:00:29,918 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b25ff627188d3ff231a5dedf1236ac28; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66505804, jitterRate=-0.008986294269561768}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:00:29,918 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b25ff627188d3ff231a5dedf1236ac28: 2023-09-24 13:00:29,920 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28., pid=6, masterSystemTime=1695560429886 2023-09-24 13:00:29,924 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28. 2023-09-24 13:00:29,925 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28. 2023-09-24 13:00:29,926 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=b25ff627188d3ff231a5dedf1236ac28, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:29,927 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695560429926"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560429926"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560429926"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560429926"}]},"ts":"1695560429926"} 2023-09-24 13:00:29,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-24 13:00:29,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure b25ff627188d3ff231a5dedf1236ac28, server=jenkins-hbase4.apache.org,35765,1695560427316 in 199 msec 2023-09-24 13:00:29,938 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-24 13:00:29,939 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=b25ff627188d3ff231a5dedf1236ac28, ASSIGN in 365 msec 2023-09-24 13:00:29,940 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 13:00:29,941 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560429940"}]},"ts":"1695560429940"} 2023-09-24 13:00:29,943 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-24 13:00:29,947 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 13:00:29,950 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 553 msec 2023-09-24 13:00:30,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-24 13:00:30,010 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-24 13:00:30,010 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 13:00:30,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:30,035 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:30,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-24 13:00:30,063 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-24 13:00:30,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 28 msec 2023-09-24 13:00:30,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-24 13:00:30,094 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-24 13:00:30,100 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-09-24 13:00:30,108 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-24 13:00:30,111 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-24 13:00:30,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.733sec 2023-09-24 13:00:30,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-24 13:00:30,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-24 13:00:30,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-24 13:00:30,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39481,1695560426000-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-24 13:00:30,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39481,1695560426000-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-24 13:00:30,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-24 13:00:30,141 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-24 13:00:30,143 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 13:00:30,144 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 13:00:30,147 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/hbase/acl/e4362ea1fc0ab0b42473229b5f7b9e2c 2023-09-24 13:00:30,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-24 13:00:30,148 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/hbase/acl/e4362ea1fc0ab0b42473229b5f7b9e2c empty. 2023-09-24 13:00:30,150 DEBUG [Listener at localhost/44849] zookeeper.ReadOnlyZKClient(139): Connect 0x52492d35 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:00:30,151 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/hbase/acl/e4362ea1fc0ab0b42473229b5f7b9e2c 2023-09-24 13:00:30,151 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-24 13:00:30,155 DEBUG [Listener at localhost/44849] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@627146cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:00:30,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-24 13:00:30,177 DEBUG [hconnection-0x3ca857b3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:30,191 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-24 13:00:30,193 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:30,193 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => e4362ea1fc0ab0b42473229b5f7b9e2c, NAME => 'hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp 2023-09-24 13:00:30,195 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39481,1695560426000 2023-09-24 13:00:30,195 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-24 13:00:30,196 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/test.cache.data in system properties and HBase conf 2023-09-24 13:00:30,196 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop.tmp.dir in system properties and HBase conf 2023-09-24 13:00:30,196 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop.log.dir in system properties and HBase conf 2023-09-24 13:00:30,196 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-24 13:00:30,196 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-24 13:00:30,196 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-24 13:00:30,196 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-24 13:00:30,196 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-24 13:00:30,196 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-24 13:00:30,196 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-24 13:00:30,196 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-24 13:00:30,196 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-24 13:00:30,196 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-24 13:00:30,196 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-24 13:00:30,197 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-24 13:00:30,197 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/nfs.dump.dir in system properties and HBase conf 2023-09-24 13:00:30,197 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/java.io.tmpdir in system properties and HBase conf 2023-09-24 13:00:30,197 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-24 13:00:30,197 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-24 13:00:30,197 INFO [Listener at localhost/44849] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-24 13:00:30,220 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:00:30,221 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing e4362ea1fc0ab0b42473229b5f7b9e2c, disabling compactions & flushes 2023-09-24 13:00:30,221 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c. 2023-09-24 13:00:30,221 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c. 2023-09-24 13:00:30,221 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c. after waiting 0 ms 2023-09-24 13:00:30,221 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c. 2023-09-24 13:00:30,221 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c. 2023-09-24 13:00:30,221 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for e4362ea1fc0ab0b42473229b5f7b9e2c: 2023-09-24 13:00:30,226 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 13:00:30,227 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695560430227"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560430227"}]},"ts":"1695560430227"} 2023-09-24 13:00:30,230 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-24 13:00:30,231 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 13:00:30,232 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560430232"}]},"ts":"1695560430232"} 2023-09-24 13:00:30,238 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-24 13:00:30,250 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 13:00:30,252 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 13:00:30,252 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 13:00:30,253 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 13:00:30,253 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 13:00:30,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=e4362ea1fc0ab0b42473229b5f7b9e2c, ASSIGN}] 2023-09-24 13:00:30,261 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=e4362ea1fc0ab0b42473229b5f7b9e2c, ASSIGN 2023-09-24 13:00:30,263 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=e4362ea1fc0ab0b42473229b5f7b9e2c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35765,1695560427316; forceNewPlan=false, retain=false 2023-09-24 13:00:30,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-24 13:00:30,413 INFO [jenkins-hbase4:39481] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-24 13:00:30,415 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e4362ea1fc0ab0b42473229b5f7b9e2c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:30,415 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695560430414"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560430414"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560430414"}]},"ts":"1695560430414"} 2023-09-24 13:00:30,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure e4362ea1fc0ab0b42473229b5f7b9e2c, server=jenkins-hbase4.apache.org,35765,1695560427316}] 2023-09-24 13:00:30,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-24 13:00:30,579 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c. 2023-09-24 13:00:30,580 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e4362ea1fc0ab0b42473229b5f7b9e2c, NAME => 'hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c.', STARTKEY => '', ENDKEY => ''} 2023-09-24 13:00:30,580 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c. service=AccessControlService 2023-09-24 13:00:30,580 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:00:30,581 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl e4362ea1fc0ab0b42473229b5f7b9e2c 2023-09-24 13:00:30,581 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:00:30,581 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e4362ea1fc0ab0b42473229b5f7b9e2c 2023-09-24 13:00:30,581 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e4362ea1fc0ab0b42473229b5f7b9e2c 2023-09-24 13:00:30,583 INFO [StoreOpener-e4362ea1fc0ab0b42473229b5f7b9e2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region e4362ea1fc0ab0b42473229b5f7b9e2c 2023-09-24 13:00:30,586 DEBUG [StoreOpener-e4362ea1fc0ab0b42473229b5f7b9e2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/acl/e4362ea1fc0ab0b42473229b5f7b9e2c/l 2023-09-24 13:00:30,586 DEBUG [StoreOpener-e4362ea1fc0ab0b42473229b5f7b9e2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/acl/e4362ea1fc0ab0b42473229b5f7b9e2c/l 2023-09-24 13:00:30,587 INFO [StoreOpener-e4362ea1fc0ab0b42473229b5f7b9e2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4362ea1fc0ab0b42473229b5f7b9e2c columnFamilyName l 2023-09-24 13:00:30,588 INFO [StoreOpener-e4362ea1fc0ab0b42473229b5f7b9e2c-1] regionserver.HStore(310): Store=e4362ea1fc0ab0b42473229b5f7b9e2c/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:00:30,590 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/acl/e4362ea1fc0ab0b42473229b5f7b9e2c 2023-09-24 13:00:30,591 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/acl/e4362ea1fc0ab0b42473229b5f7b9e2c 2023-09-24 13:00:30,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e4362ea1fc0ab0b42473229b5f7b9e2c 2023-09-24 13:00:30,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/acl/e4362ea1fc0ab0b42473229b5f7b9e2c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:00:30,602 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e4362ea1fc0ab0b42473229b5f7b9e2c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71252696, jitterRate=0.06174790859222412}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:00:30,602 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e4362ea1fc0ab0b42473229b5f7b9e2c: 2023-09-24 13:00:30,604 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c., pid=11, masterSystemTime=1695560430573 2023-09-24 13:00:30,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c. 2023-09-24 13:00:30,607 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c. 2023-09-24 13:00:30,608 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=e4362ea1fc0ab0b42473229b5f7b9e2c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:30,608 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695560430608"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560430608"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560430608"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560430608"}]},"ts":"1695560430608"} 2023-09-24 13:00:30,618 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-24 13:00:30,618 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure e4362ea1fc0ab0b42473229b5f7b9e2c, server=jenkins-hbase4.apache.org,35765,1695560427316 in 193 msec 2023-09-24 13:00:30,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-24 13:00:30,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=e4362ea1fc0ab0b42473229b5f7b9e2c, ASSIGN in 364 msec 2023-09-24 13:00:30,624 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 13:00:30,624 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560430624"}]},"ts":"1695560430624"} 2023-09-24 13:00:30,627 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-24 13:00:30,631 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 13:00:30,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 492 msec 2023-09-24 13:00:30,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-24 13:00:30,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-24 13:00:30,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-24 13:00:31,381 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 13:00:31,757 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 13:00:31,764 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40115_jobhistory____.l318qm/webapp 2023-09-24 13:00:31,947 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-24 13:00:31,947 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-24 13:00:31,947 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-24 13:00:31,951 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-24 13:00:32,043 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 13:00:32,385 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 13:00:32,695 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-24 13:00:32,726 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40115 2023-09-24 13:00:32,873 WARN [Listener at jenkins-hbase4.apache.org/42831] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 13:00:33,152 WARN [Listener at jenkins-hbase4.apache.org/42831] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-24 13:00:33,153 INFO [Listener at jenkins-hbase4.apache.org/42831] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 13:00:33,163 INFO [Listener at jenkins-hbase4.apache.org/42831] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37595_cluster____3z8cbb/webapp 2023-09-24 13:00:33,242 INFO [Listener at jenkins-hbase4.apache.org/42831] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-24 13:00:33,242 INFO [Listener at jenkins-hbase4.apache.org/42831] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-24 13:00:33,243 INFO [Listener at jenkins-hbase4.apache.org/42831] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-24 13:00:33,243 INFO [Listener at jenkins-hbase4.apache.org/42831] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-24 13:00:33,252 INFO [Listener at jenkins-hbase4.apache.org/42831] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 13:00:33,466 INFO [Listener at jenkins-hbase4.apache.org/42831] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 13:00:33,571 INFO [Listener at jenkins-hbase4.apache.org/42831] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 13:00:33,579 INFO [Listener at jenkins-hbase4.apache.org/42831] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37595 2023-09-24 13:00:34,035 WARN [Listener at jenkins-hbase4.apache.org/44331] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 13:00:34,062 WARN [Listener at jenkins-hbase4.apache.org/44331] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-24 13:00:34,063 INFO [Listener at jenkins-hbase4.apache.org/44331] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 13:00:34,070 INFO [Listener at jenkins-hbase4.apache.org/44331] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38837_node____.wt3stn/webapp 2023-09-24 13:00:34,122 INFO [Listener at jenkins-hbase4.apache.org/44331] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-24 13:00:34,123 INFO [Listener at jenkins-hbase4.apache.org/44331] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-24 13:00:34,123 INFO [Listener at jenkins-hbase4.apache.org/44331] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-24 13:00:34,123 INFO [Listener at jenkins-hbase4.apache.org/44331] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-24 13:00:34,132 INFO [Listener at jenkins-hbase4.apache.org/44331] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 13:00:34,152 INFO [Listener at jenkins-hbase4.apache.org/44331] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 13:00:34,274 INFO [Listener at jenkins-hbase4.apache.org/44331] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 13:00:34,288 INFO [Listener at jenkins-hbase4.apache.org/44331] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38837 2023-09-24 13:00:34,469 WARN [Listener at jenkins-hbase4.apache.org/34119] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-24 13:00:34,475 WARN [Listener at jenkins-hbase4.apache.org/34119] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-24 13:00:34,475 INFO [Listener at jenkins-hbase4.apache.org/34119] log.Slf4jLog(67): jetty-6.1.26 2023-09-24 13:00:34,482 INFO [Listener at jenkins-hbase4.apache.org/34119] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39197_node____fsjb53/webapp 2023-09-24 13:00:34,533 INFO [Listener at jenkins-hbase4.apache.org/34119] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-24 13:00:34,533 INFO [Listener at jenkins-hbase4.apache.org/34119] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-24 13:00:34,533 INFO [Listener at jenkins-hbase4.apache.org/34119] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-24 13:00:34,533 INFO [Listener at jenkins-hbase4.apache.org/34119] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-24 13:00:34,541 INFO [Listener at jenkins-hbase4.apache.org/34119] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 13:00:34,561 INFO [Listener at jenkins-hbase4.apache.org/34119] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 13:00:34,631 INFO [Listener at jenkins-hbase4.apache.org/34119] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-24 13:00:34,638 INFO [Listener at jenkins-hbase4.apache.org/34119] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39197 2023-09-24 13:00:34,661 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-24 13:00:34,662 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 13:00:34,712 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 13:00:34,728 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=702, OpenFileDescriptor=894, MaxFileDescriptor=60000, SystemLoadAverage=124, ProcessCount=164, AvailableMemoryMB=8461 2023-09-24 13:00:34,728 WARN [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(130): Thread=702 is superior to 500 2023-09-24 13:00:34,759 DEBUG [Listener at jenkins-hbase4.apache.org/34119] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-24 13:00:34,765 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-24 13:00:34,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 13:00:34,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-24 13:00:34,785 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 13:00:34,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-24 13:00:34,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-24 13:00:34,794 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 13:00:34,801 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019 2023-09-24 13:00:34,805 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019 empty. 2023-09-24 13:00:34,805 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029 2023-09-24 13:00:34,807 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019 2023-09-24 13:00:34,812 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029 empty. 2023-09-24 13:00:34,814 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029 2023-09-24 13:00:34,814 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-24 13:00:34,869 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-24 13:00:34,872 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 815c9ea1c5d0b0fd785e66f982c6a019, NAME => 'testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp 2023-09-24 13:00:34,873 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 69cdad1861b2e39ddaaeaeb4e5263029, NAME => 'testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp 2023-09-24 13:00:34,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-24 13:00:34,928 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-24 13:00:34,939 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-24 13:00:34,946 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-24 13:00:34,950 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:00:34,950 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:00:34,950 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 815c9ea1c5d0b0fd785e66f982c6a019, disabling compactions & flushes 2023-09-24 13:00:34,950 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 69cdad1861b2e39ddaaeaeb4e5263029, disabling compactions & flushes 2023-09-24 13:00:34,951 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:34,951 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. 2023-09-24 13:00:34,951 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:34,951 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. 2023-09-24 13:00:34,951 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. after waiting 0 ms 2023-09-24 13:00:34,951 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. after waiting 0 ms 2023-09-24 13:00:34,951 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:34,951 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. 2023-09-24 13:00:34,951 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:34,951 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. 2023-09-24 13:00:34,951 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 815c9ea1c5d0b0fd785e66f982c6a019: 2023-09-24 13:00:34,951 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 69cdad1861b2e39ddaaeaeb4e5263029: 2023-09-24 13:00:34,955 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 13:00:34,957 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695560434956"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560434956"}]},"ts":"1695560434956"} 2023-09-24 13:00:34,957 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695560434956"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560434956"}]},"ts":"1695560434956"} 2023-09-24 13:00:35,003 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 13:00:35,005 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 13:00:35,005 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560435005"}]},"ts":"1695560435005"} 2023-09-24 13:00:35,007 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-24 13:00:35,014 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 13:00:35,016 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 13:00:35,016 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 13:00:35,016 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 13:00:35,016 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 13:00:35,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=815c9ea1c5d0b0fd785e66f982c6a019, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=69cdad1861b2e39ddaaeaeb4e5263029, ASSIGN}] 2023-09-24 13:00:35,019 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=69cdad1861b2e39ddaaeaeb4e5263029, ASSIGN 2023-09-24 13:00:35,019 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=815c9ea1c5d0b0fd785e66f982c6a019, ASSIGN 2023-09-24 13:00:35,020 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=69cdad1861b2e39ddaaeaeb4e5263029, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35765,1695560427316; forceNewPlan=false, retain=false 2023-09-24 13:00:35,021 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=815c9ea1c5d0b0fd785e66f982c6a019, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44885,1695560427276; forceNewPlan=false, retain=false 2023-09-24 13:00:35,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-24 13:00:35,171 INFO [jenkins-hbase4:39481] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 13:00:35,173 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=815c9ea1c5d0b0fd785e66f982c6a019, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:35,173 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=69cdad1861b2e39ddaaeaeb4e5263029, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:35,173 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695560435173"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560435173"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560435173"}]},"ts":"1695560435173"} 2023-09-24 13:00:35,174 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695560435173"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560435173"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560435173"}]},"ts":"1695560435173"} 2023-09-24 13:00:35,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 815c9ea1c5d0b0fd785e66f982c6a019, server=jenkins-hbase4.apache.org,44885,1695560427276}] 2023-09-24 13:00:35,178 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 69cdad1861b2e39ddaaeaeb4e5263029, server=jenkins-hbase4.apache.org,35765,1695560427316}] 2023-09-24 13:00:35,330 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:35,331 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 13:00:35,335 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 13:00:35,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. 2023-09-24 13:00:35,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 69cdad1861b2e39ddaaeaeb4e5263029, NAME => 'testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 13:00:35,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. service=AccessControlService 2023-09-24 13:00:35,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:00:35,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 69cdad1861b2e39ddaaeaeb4e5263029 2023-09-24 13:00:35,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:00:35,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:35,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 69cdad1861b2e39ddaaeaeb4e5263029 2023-09-24 13:00:35,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 69cdad1861b2e39ddaaeaeb4e5263029 2023-09-24 13:00:35,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 815c9ea1c5d0b0fd785e66f982c6a019, NAME => 'testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 13:00:35,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. service=AccessControlService 2023-09-24 13:00:35,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:00:35,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 815c9ea1c5d0b0fd785e66f982c6a019 2023-09-24 13:00:35,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:00:35,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 815c9ea1c5d0b0fd785e66f982c6a019 2023-09-24 13:00:35,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 815c9ea1c5d0b0fd785e66f982c6a019 2023-09-24 13:00:35,348 INFO [StoreOpener-815c9ea1c5d0b0fd785e66f982c6a019-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 815c9ea1c5d0b0fd785e66f982c6a019 2023-09-24 13:00:35,348 INFO [StoreOpener-69cdad1861b2e39ddaaeaeb4e5263029-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 69cdad1861b2e39ddaaeaeb4e5263029 2023-09-24 13:00:35,350 DEBUG [StoreOpener-815c9ea1c5d0b0fd785e66f982c6a019-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019/cf 2023-09-24 13:00:35,350 DEBUG [StoreOpener-815c9ea1c5d0b0fd785e66f982c6a019-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019/cf 2023-09-24 13:00:35,350 DEBUG [StoreOpener-69cdad1861b2e39ddaaeaeb4e5263029-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029/cf 2023-09-24 13:00:35,350 DEBUG [StoreOpener-69cdad1861b2e39ddaaeaeb4e5263029-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029/cf 2023-09-24 13:00:35,354 INFO [StoreOpener-815c9ea1c5d0b0fd785e66f982c6a019-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 815c9ea1c5d0b0fd785e66f982c6a019 columnFamilyName cf 2023-09-24 13:00:35,354 INFO [StoreOpener-69cdad1861b2e39ddaaeaeb4e5263029-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69cdad1861b2e39ddaaeaeb4e5263029 columnFamilyName cf 2023-09-24 13:00:35,357 INFO [StoreOpener-815c9ea1c5d0b0fd785e66f982c6a019-1] regionserver.HStore(310): Store=815c9ea1c5d0b0fd785e66f982c6a019/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:00:35,357 INFO [StoreOpener-69cdad1861b2e39ddaaeaeb4e5263029-1] regionserver.HStore(310): Store=69cdad1861b2e39ddaaeaeb4e5263029/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:00:35,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029 2023-09-24 13:00:35,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019 2023-09-24 13:00:35,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029 2023-09-24 13:00:35,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019 2023-09-24 13:00:35,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 69cdad1861b2e39ddaaeaeb4e5263029 2023-09-24 13:00:35,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 815c9ea1c5d0b0fd785e66f982c6a019 2023-09-24 13:00:35,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:00:35,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 69cdad1861b2e39ddaaeaeb4e5263029; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62887480, jitterRate=-0.0629035234451294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:00:35,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 69cdad1861b2e39ddaaeaeb4e5263029: 2023-09-24 13:00:35,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:00:35,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029., pid=16, masterSystemTime=1695560435330 2023-09-24 13:00:35,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 815c9ea1c5d0b0fd785e66f982c6a019; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59545331, jitterRate=-0.11270542442798615}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:00:35,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 815c9ea1c5d0b0fd785e66f982c6a019: 2023-09-24 13:00:35,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019., pid=15, masterSystemTime=1695560435330 2023-09-24 13:00:35,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. 2023-09-24 13:00:35,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. 2023-09-24 13:00:35,384 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=69cdad1861b2e39ddaaeaeb4e5263029, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:35,384 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695560435384"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560435384"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560435384"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560435384"}]},"ts":"1695560435384"} 2023-09-24 13:00:35,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:35,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:35,386 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=815c9ea1c5d0b0fd785e66f982c6a019, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:35,387 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695560435386"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560435386"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560435386"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560435386"}]},"ts":"1695560435386"} 2023-09-24 13:00:35,392 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-24 13:00:35,392 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 69cdad1861b2e39ddaaeaeb4e5263029, server=jenkins-hbase4.apache.org,35765,1695560427316 in 211 msec 2023-09-24 13:00:35,395 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-24 13:00:35,398 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 815c9ea1c5d0b0fd785e66f982c6a019, server=jenkins-hbase4.apache.org,44885,1695560427276 in 215 msec 2023-09-24 13:00:35,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=69cdad1861b2e39ddaaeaeb4e5263029, ASSIGN in 376 msec 2023-09-24 13:00:35,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-24 13:00:35,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=815c9ea1c5d0b0fd785e66f982c6a019, ASSIGN in 382 msec 2023-09-24 13:00:35,404 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 13:00:35,404 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560435404"}]},"ts":"1695560435404"} 2023-09-24 13:00:35,406 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-24 13:00:35,409 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 13:00:35,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-24 13:00:35,414 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-24 13:00:35,423 DEBUG [hconnection-0x10120d0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:35,426 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-09-24 13:00:35,434 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35765] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-24 13:00:35,466 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-24 13:00:35,466 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-24 13:00:35,466 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-24 13:00:35,466 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 13:00:35,466 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-24 13:00:35,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-24 13:00:35,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-24 13:00:35,474 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-24 13:00:35,475 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-24 13:00:35,478 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 695 msec 2023-09-24 13:00:35,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-24 13:00:35,914 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-24 13:00:35,918 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-24 13:00:35,919 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:35,922 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 13:00:35,947 DEBUG [hconnection-0x3ca857b3-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:35,952 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:35,955 DEBUG [hconnection-0x3ca857b3-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:35,957 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:35,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 13:00:35,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695560435971 (current time:1695560435971). 2023-09-24 13:00:35,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 13:00:35,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x05480ddd to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:00:35,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c0c4070, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:00:35,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:35,983 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:35,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05480ddd to 127.0.0.1:55856 2023-09-24 13:00:35,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:00:35,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x2af28e35 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:00:35,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c8afd9c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:00:35,994 DEBUG [hconnection-0x392f481e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:35,995 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:35,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:36,002 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:36,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2af28e35 to 127.0.0.1:55856 2023-09-24 13:00:36,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:00:36,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-24 13:00:36,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 13:00:36,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 13:00:36,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 13:00:36,050 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 13:00:36,052 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695561036052 2023-09-24 13:00:36,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 13:00:36,052 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-24 13:00:36,055 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 13:00:36,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 13:00:36,057 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-09-24 13:00:36,058 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 13:00:36,059 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695561036059 2023-09-24 13:00:36,061 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 13:00:36,061 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 13:00:36,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,094 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-24 13:00:36,094 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:00:36,095 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-24 13:00:36,095 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-24 13:00:36,096 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,096 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,102 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:36,102 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:36,102 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:36,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:36,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:36,103 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:36,103 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,103 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,104 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,104 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 13:00:36,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-24 13:00:36,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-24 13:00:36,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-24 13:00:36,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,106 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 13:00:36,106 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 13:00:36,106 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 13:00:36,113 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,114 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,114 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,114 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 13:00:36,114 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 13:00:36,114 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:00:36,114 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:00:36,115 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 13:00:36,114 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 13:00:36,116 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-24 13:00:36,116 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 13:00:36,116 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-24 13:00:36,116 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-24 13:00:36,116 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:00:36,116 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-24 13:00:36,117 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 13:00:36,117 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-24 13:00:36,117 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-24 13:00:36,120 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,120 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,120 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,120 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:36,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:36,120 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,120 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:36,121 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,121 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:00:36,121 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:00:36,121 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,121 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:00:36,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:36,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:36,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-24 13:00:36,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22a17d31[Count = 1] remaining members to acquire global barrier 2023-09-24 13:00:36,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:36,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:36,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:36,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:36,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:36,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-24 13:00:36,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22a17d31[Count = 0] remaining members to acquire global barrier 2023-09-24 13:00:36,127 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-24 13:00:36,127 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,131 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,131 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,131 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,131 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 13:00:36,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,131 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-24 13:00:36,131 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,131 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40801,1695560427220' in zk 2023-09-24 13:00:36,131 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 13:00:36,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,132 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 13:00:36,132 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,132 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 13:00:36,133 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:00:36,133 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:00:36,133 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:36,133 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:00:36,133 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:00:36,133 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. 2023-09-24 13:00:36,134 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 13:00:36,134 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. started... 2023-09-24 13:00:36,134 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:00:36,134 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. started... 2023-09-24 13:00:36,134 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-24 13:00:36,137 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69cdad1861b2e39ddaaeaeb4e5263029: 2023-09-24 13:00:36,137 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 815c9ea1c5d0b0fd785e66f982c6a019: 2023-09-24 13:00:36,138 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,138 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,144 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:00:36,144 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:00:36,148 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 13:00:36,148 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 13:00:36,161 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:00:36,161 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:00:36,162 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-24 13:00:36,162 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:00:36,162 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-24 13:00:36,162 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-24 13:00:36,162 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-24 13:00:36,162 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:00:36,162 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-24 13:00:36,163 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-24 13:00:36,163 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-24 13:00:36,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-24 13:00:36,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-24 13:00:36,180 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 13:00:36,190 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. completed. 2023-09-24 13:00:36,190 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. 2023-09-24 13:00:36,190 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:00:36,190 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:00:36,190 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,190 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-24 13:00:36,190 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35765,1695560427316' in zk 2023-09-24 13:00:36,192 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. completed. 2023-09-24 13:00:36,192 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:36,192 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:00:36,192 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:00:36,192 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,192 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-24 13:00:36,192 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44885,1695560427276' in zk 2023-09-24 13:00:36,192 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,193 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 13:00:36,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:36,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:36,193 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:00:36,193 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-24 13:00:36,195 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 13:00:36,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:36,195 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:00:36,195 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,195 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-24 13:00:36,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:36,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:36,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35765,1695560427316': 2023-09-24 13:00:36,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-24 13:00:36,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:36,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:36,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:36,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:36,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:36,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44885,1695560427276': 2023-09-24 13:00:36,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-24 13:00:36,206 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-24 13:00:36,206 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 13:00:36,206 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 13:00:36,206 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,206 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 13:00:36,211 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,211 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:36,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,211 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:36,211 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,211 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,211 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:36,211 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:36,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:36,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:36,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:36,212 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:36,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:36,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:36,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:36,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:36,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,213 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,213 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:36,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,215 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,216 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:36,216 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,229 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,229 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:36,229 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:36,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:36,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:36,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:36,229 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:36,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:36,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:36,229 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:36,229 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,229 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:36,229 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,229 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,229 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:00:36,229 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-24 13:00:36,229 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:36,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:36,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:36,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:36,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:36,229 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:36,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:36,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:36,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 13:00:36,231 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,231 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,231 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,231 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,231 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,231 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,231 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 13:00:36,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,315 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-24 13:00:36,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,316 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:36,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695560436052Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695560436255 (+203 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695560436255Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695560436255Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695560436267 (+12 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695560436301 (+34 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695560436315 (+14 ms) 2023-09-24 13:00:36,319 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 13:00:36,321 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 264 msec 2023-09-24 13:00:36,380 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:00:36,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-24 13:00:36,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 13:00:36,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44885] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 13:00:36,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35765] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 13:00:36,411 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-24 13:00:36,411 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:36,411 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 13:00:36,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 13:00:36,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695560436427 (current time:1695560436427). 2023-09-24 13:00:36,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 13:00:36,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x25e6f639 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:00:36,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69f97227, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:00:36,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:36,440 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:36,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25e6f639 to 127.0.0.1:55856 2023-09-24 13:00:36,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:00:36,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x15c6f830 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:00:36,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@783838f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:00:36,450 DEBUG [hconnection-0x2549b112-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:36,452 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:36,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:36,461 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:36,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15c6f830 to 127.0.0.1:55856 2023-09-24 13:00:36,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:00:36,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-24 13:00:36,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 13:00:36,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 13:00:36,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 13:00:36,468 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 13:00:36,469 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695561036469 2023-09-24 13:00:36,470 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-24 13:00:36,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-24 13:00:36,471 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 13:00:36,471 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 13:00:36,472 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-24 13:00:36,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 13:00:36,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-24 13:00:36,475 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 13:00:36,476 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695561036476 2023-09-24 13:00:36,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-24 13:00:36,492 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-24 13:00:36,492 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:00:36,493 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-24 13:00:36,493 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-24 13:00:36,494 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,494 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,495 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:36,495 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:36,495 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:36,495 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:36,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:36,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:36,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:36,496 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,496 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:36,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:36,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,496 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,496 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 13:00:36,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-24 13:00:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-24 13:00:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-24 13:00:36,497 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 13:00:36,497 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 13:00:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-24 13:00:36,498 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-24 13:00:36,498 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 13:00:36,498 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:00:36,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-24 13:00:36,499 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 13:00:36,499 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 13:00:36,499 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:00:36,499 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-24 13:00:36,499 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-24 13:00:36,502 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-24 13:00:36,503 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:00:36,502 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 13:00:36,503 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-24 13:00:36,503 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-24 13:00:36,504 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-24 13:00:36,503 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-24 13:00:36,503 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-24 13:00:36,504 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-24 13:00:36,506 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,506 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:36,507 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,507 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:36,508 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,508 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:00:36,507 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,508 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,508 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:00:36,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:36,508 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,508 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:00:36,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 13:00:36,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:36,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-24 13:00:36,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b20754[Count = 1] remaining members to acquire global barrier 2023-09-24 13:00:36,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:36,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:36,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:36,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:36,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 13:00:36,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:36,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-24 13:00:36,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b20754[Count = 0] remaining members to acquire global barrier 2023-09-24 13:00:36,513 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-24 13:00:36,513 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,516 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,516 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,516 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,517 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,517 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 13:00:36,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,517 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 13:00:36,517 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,517 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:00:36,517 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:00:36,517 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-24 13:00:36,517 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:36,517 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-24 13:00:36,517 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:00:36,517 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. started... 2023-09-24 13:00:36,517 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. 2023-09-24 13:00:36,517 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 13:00:36,517 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. started... 2023-09-24 13:00:36,518 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 815c9ea1c5d0b0fd785e66f982c6a019 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-24 13:00:36,517 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:00:36,517 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40801,1695560427220' in zk 2023-09-24 13:00:36,518 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 69cdad1861b2e39ddaaeaeb4e5263029 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-24 13:00:36,520 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 13:00:36,520 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:00:36,520 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-24 13:00:36,572 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:00:36,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-24 13:00:36,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-24 13:00:36,573 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 13:00:36,661 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309244475622afc1943ac9bb8489a4f2760d6 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309244475622afc1943ac9bb8489a4f2760d6 2023-09-24 13:00:36,661 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230924f53223867cf04658af54602686438f91 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230924f53223867cf04658af54602686438f91 2023-09-24 13:00:36,694 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019/.tmp/cf/7cf0fd6f8c84409f921a2e08ff53b0f8 2023-09-24 13:00:36,695 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029/.tmp/cf/0f876b7176c74a7caa58a67cef0252af 2023-09-24 13:00:36,705 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029/.tmp/cf/0f876b7176c74a7caa58a67cef0252af as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029/cf/0f876b7176c74a7caa58a67cef0252af 2023-09-24 13:00:36,705 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019/.tmp/cf/7cf0fd6f8c84409f921a2e08ff53b0f8 as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019/cf/7cf0fd6f8c84409f921a2e08ff53b0f8 2023-09-24 13:00:36,714 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019/cf/7cf0fd6f8c84409f921a2e08ff53b0f8, entries=4, sequenceid=6, filesize=5.6 K 2023-09-24 13:00:36,714 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029/cf/0f876b7176c74a7caa58a67cef0252af, entries=46, sequenceid=6, filesize=12.6 K 2023-09-24 13:00:36,718 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 815c9ea1c5d0b0fd785e66f982c6a019 in 200ms, sequenceid=6, compaction requested=false 2023-09-24 13:00:36,718 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 69cdad1861b2e39ddaaeaeb4e5263029 in 200ms, sequenceid=6, compaction requested=false 2023-09-24 13:00:36,718 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-24 13:00:36,718 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-24 13:00:36,721 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 815c9ea1c5d0b0fd785e66f982c6a019: 2023-09-24 13:00:36,721 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69cdad1861b2e39ddaaeaeb4e5263029: 2023-09-24 13:00:36,721 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-24 13:00:36,721 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-24 13:00:36,721 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:00:36,721 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:00:36,721 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019/cf/7cf0fd6f8c84409f921a2e08ff53b0f8] hfiles 2023-09-24 13:00:36,721 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029/cf/0f876b7176c74a7caa58a67cef0252af] hfiles 2023-09-24 13:00:36,721 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019/cf/7cf0fd6f8c84409f921a2e08ff53b0f8 for snapshot=snaptb0-testExportWithTargetName 2023-09-24 13:00:36,721 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029/cf/0f876b7176c74a7caa58a67cef0252af for snapshot=snaptb0-testExportWithTargetName 2023-09-24 13:00:36,753 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. completed. 2023-09-24 13:00:36,753 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:36,753 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. completed. 2023-09-24 13:00:36,753 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. 2023-09-24 13:00:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:00:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:00:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:00:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:00:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-24 13:00:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35765,1695560427316' in zk 2023-09-24 13:00:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-24 13:00:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,44885,1695560427276' in zk 2023-09-24 13:00:36,755 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,755 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 13:00:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,755 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:00:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:36,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:36,755 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-24 13:00:36,757 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,757 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-24 13:00:36,757 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:00:36,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:36,757 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-24 13:00:36,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:36,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 13:00:36,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:36,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 13:00:36,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35765,1695560427316': 2023-09-24 13:00:36,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-24 13:00:36,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:36,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:36,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:36,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:36,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 13:00:36,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:36,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 13:00:36,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,44885,1695560427276': 2023-09-24 13:00:36,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-24 13:00:36,771 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-24 13:00:36,771 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 13:00:36,771 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 13:00:36,771 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-24 13:00:36,771 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 13:00:36,773 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,773 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,773 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,773 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:36,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,773 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:36,773 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,774 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:00:36,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:36,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:36,774 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,774 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:36,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:36,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:36,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:36,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:36,775 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:36,776 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 13:00:36,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:36,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 13:00:36,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,778 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:36,778 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-24 13:00:36,779 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:36,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:36,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-24 13:00:36,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-24 13:00:36,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,781 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-24 13:00:36,790 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:36,790 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:36,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:36,790 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:36,791 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:36,790 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-09-24 13:00:36,791 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:36,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:36,791 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:00:36,791 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-09-24 13:00:36,791 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:36,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:36,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:36,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:36,792 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,791 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-24 13:00:36,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:36,792 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-24 13:00:36,792 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,792 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-24 13:00:36,792 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:36,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 13:00:36,792 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:36,793 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:36,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:36,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:36,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:36,793 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:36,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:36,793 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:36,793 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309244475622afc1943ac9bb8489a4f2760d6, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230924f53223867cf04658af54602686438f91] mob files 2023-09-24 13:00:36,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309244475622afc1943ac9bb8489a4f2760d6 2023-09-24 13:00:36,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230924f53223867cf04658af54602686438f91 2023-09-24 13:00:36,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-24 13:00:36,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,855 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-24 13:00:36,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,856 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-24 13:00:36,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695560436470Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695560436811 (+341 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695560436811Loading Region manifests for snaptb0-testExportWithTargetName at 1695560436811Writing data manifest for snaptb0-testExportWithTargetName at 1695560436820 (+9 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695560436842 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695560436855 (+13 ms) 2023-09-24 13:00:36,859 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-24 13:00:36,862 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 390 msec 2023-09-24 13:00:37,083 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:00:37,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-24 13:00:37,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 13:00:37,086 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560437086 2023-09-24 13:00:37,087 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36659, tgtDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560437086, rawTgtDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560437086, srcFsUri=hdfs://localhost:36659, srcDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:00:37,126 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36659, inputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:00:37,126 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-748399963_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560437086, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560437086/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-24 13:00:37,126 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36659, inputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68, snapshotDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-24 13:00:37,147 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560437086/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-24 13:00:37,216 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:37,217 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:37,218 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:37,218 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:38,163 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop-5589185233988833358.jar 2023-09-24 13:00:38,164 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:38,164 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:38,231 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop-8910508086075492047.jar 2023-09-24 13:00:38,232 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:38,232 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:38,233 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:38,233 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:38,234 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:38,234 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:38,235 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 13:00:38,235 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 13:00:38,236 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 13:00:38,236 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 13:00:38,236 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 13:00:38,237 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 13:00:38,237 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 13:00:38,238 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 13:00:38,238 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 13:00:38,239 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 13:00:38,243 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:00:38,243 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:00:38,243 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:00:38,244 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:00:38,244 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:00:38,244 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:00:38,245 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:00:39,030 WARN [Listener at jenkins-hbase4.apache.org/34119] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 13:00:39,037 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-24 13:00:39,047 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-24 13:00:39,501 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 13:00:39,503 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 13:00:39,835 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0001_000001 (auth:SIMPLE) 2023-09-24 13:00:40,848 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 13:00:44,377 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0001_000001 (auth:SIMPLE) 2023-09-24 13:00:46,638 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0001_000001 (auth:SIMPLE) 2023-09-24 13:00:49,414 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0001_000001 (auth:SIMPLE) 2023-09-24 13:00:50,900 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 13:00:50,904 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 13:00:50,916 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-24 13:00:50,917 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 13:00:50,918 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 13:00:50,918 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1579157240_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-24 13:00:50,919 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-24 13:00:50,919 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-24 13:00:50,919 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1579157240_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560437086/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560437086/.hbase-snapshot/testExportWithTargetName 2023-09-24 13:00:50,919 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560437086/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-24 13:00:50,919 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560437086/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-24 13:00:50,933 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-24 13:00:50,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-24 13:00:50,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-24 13:00:50,952 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560450952"}]},"ts":"1695560450952"} 2023-09-24 13:00:50,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-24 13:00:50,955 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-24 13:00:50,956 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-24 13:00:50,958 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=815c9ea1c5d0b0fd785e66f982c6a019, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=69cdad1861b2e39ddaaeaeb4e5263029, UNASSIGN}] 2023-09-24 13:00:50,960 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=815c9ea1c5d0b0fd785e66f982c6a019, UNASSIGN 2023-09-24 13:00:50,960 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=69cdad1861b2e39ddaaeaeb4e5263029, UNASSIGN 2023-09-24 13:00:50,961 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=69cdad1861b2e39ddaaeaeb4e5263029, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:50,961 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=815c9ea1c5d0b0fd785e66f982c6a019, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:50,962 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695560450961"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560450961"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560450961"}]},"ts":"1695560450961"} 2023-09-24 13:00:50,962 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695560450961"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560450961"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560450961"}]},"ts":"1695560450961"} 2023-09-24 13:00:50,963 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 69cdad1861b2e39ddaaeaeb4e5263029, server=jenkins-hbase4.apache.org,35765,1695560427316}] 2023-09-24 13:00:50,964 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 815c9ea1c5d0b0fd785e66f982c6a019, server=jenkins-hbase4.apache.org,44885,1695560427276}] 2023-09-24 13:00:51,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-24 13:00:51,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 69cdad1861b2e39ddaaeaeb4e5263029 2023-09-24 13:00:51,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 815c9ea1c5d0b0fd785e66f982c6a019 2023-09-24 13:00:51,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 69cdad1861b2e39ddaaeaeb4e5263029, disabling compactions & flushes 2023-09-24 13:00:51,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 815c9ea1c5d0b0fd785e66f982c6a019, disabling compactions & flushes 2023-09-24 13:00:51,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. 2023-09-24 13:00:51,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:51,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. 2023-09-24 13:00:51,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:51,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. after waiting 0 ms 2023-09-24 13:00:51,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. after waiting 0 ms 2023-09-24 13:00:51,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. 2023-09-24 13:00:51,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:51,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 13:00:51,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 13:00:51,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:00:51,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:00:51,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019. 2023-09-24 13:00:51,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029. 2023-09-24 13:00:51,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 815c9ea1c5d0b0fd785e66f982c6a019: 2023-09-24 13:00:51,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 69cdad1861b2e39ddaaeaeb4e5263029: 2023-09-24 13:00:51,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 69cdad1861b2e39ddaaeaeb4e5263029 2023-09-24 13:00:51,146 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=69cdad1861b2e39ddaaeaeb4e5263029, regionState=CLOSED 2023-09-24 13:00:51,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 815c9ea1c5d0b0fd785e66f982c6a019 2023-09-24 13:00:51,146 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695560451146"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560451146"}]},"ts":"1695560451146"} 2023-09-24 13:00:51,147 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=815c9ea1c5d0b0fd785e66f982c6a019, regionState=CLOSED 2023-09-24 13:00:51,147 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695560451147"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560451147"}]},"ts":"1695560451147"} 2023-09-24 13:00:51,150 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-24 13:00:51,151 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 69cdad1861b2e39ddaaeaeb4e5263029, server=jenkins-hbase4.apache.org,35765,1695560427316 in 185 msec 2023-09-24 13:00:51,153 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-24 13:00:51,153 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 815c9ea1c5d0b0fd785e66f982c6a019, server=jenkins-hbase4.apache.org,44885,1695560427276 in 185 msec 2023-09-24 13:00:51,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=69cdad1861b2e39ddaaeaeb4e5263029, UNASSIGN in 193 msec 2023-09-24 13:00:51,155 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-24 13:00:51,155 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=815c9ea1c5d0b0fd785e66f982c6a019, UNASSIGN in 195 msec 2023-09-24 13:00:51,156 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560451156"}]},"ts":"1695560451156"} 2023-09-24 13:00:51,158 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-24 13:00:51,159 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-24 13:00:51,162 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 218 msec 2023-09-24 13:00:51,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-24 13:00:51,257 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-24 13:00:51,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-24 13:00:51,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 13:00:51,271 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 13:00:51,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-24 13:00:51,273 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 13:00:51,276 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35765] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-24 13:00:51,279 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019 2023-09-24 13:00:51,279 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029 2023-09-24 13:00:51,280 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-24 13:00:51,280 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-24 13:00:51,281 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-24 13:00:51,281 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-24 13:00:51,282 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:00:51,283 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:00:51,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-24 13:00:51,283 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 13:00:51,283 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:00:51,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-24 13:00:51,283 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 13:00:51,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-24 13:00:51,283 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:00:51,283 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 13:00:51,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-24 13:00:51,284 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-24 13:00:51,284 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019/cf, FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019/recovered.edits] 2023-09-24 13:00:51,284 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029/cf, FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029/recovered.edits] 2023-09-24 13:00:51,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-24 13:00:51,292 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029/cf/0f876b7176c74a7caa58a67cef0252af to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029/cf/0f876b7176c74a7caa58a67cef0252af 2023-09-24 13:00:51,292 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019/cf/7cf0fd6f8c84409f921a2e08ff53b0f8 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019/cf/7cf0fd6f8c84409f921a2e08ff53b0f8 2023-09-24 13:00:51,297 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029/recovered.edits/9.seqid to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029/recovered.edits/9.seqid 2023-09-24 13:00:51,297 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019/recovered.edits/9.seqid to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019/recovered.edits/9.seqid 2023-09-24 13:00:51,298 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/69cdad1861b2e39ddaaeaeb4e5263029 2023-09-24 13:00:51,298 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportWithTargetName/815c9ea1c5d0b0fd785e66f982c6a019 2023-09-24 13:00:51,298 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-24 13:00:51,298 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-24 13:00:51,299 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-24 13:00:51,304 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309244475622afc1943ac9bb8489a4f2760d6 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309244475622afc1943ac9bb8489a4f2760d6 2023-09-24 13:00:51,305 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230924f53223867cf04658af54602686438f91 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230924f53223867cf04658af54602686438f91 2023-09-24 13:00:51,306 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-24 13:00:51,308 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 13:00:51,333 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-24 13:00:51,336 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-24 13:00:51,337 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 13:00:51,337 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-24 13:00:51,338 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695560451337"}]},"ts":"9223372036854775807"} 2023-09-24 13:00:51,338 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695560451337"}]},"ts":"9223372036854775807"} 2023-09-24 13:00:51,340 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 13:00:51,340 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 815c9ea1c5d0b0fd785e66f982c6a019, NAME => 'testtb-testExportWithTargetName,,1695560434778.815c9ea1c5d0b0fd785e66f982c6a019.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 69cdad1861b2e39ddaaeaeb4e5263029, NAME => 'testtb-testExportWithTargetName,1,1695560434778.69cdad1861b2e39ddaaeaeb4e5263029.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 13:00:51,340 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-24 13:00:51,340 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695560451340"}]},"ts":"9223372036854775807"} 2023-09-24 13:00:51,342 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-24 13:00:51,344 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-24 13:00:51,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 81 msec 2023-09-24 13:00:51,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-24 13:00:51,391 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-24 13:00:51,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-24 13:00:51,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-24 13:00:51,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-24 13:00:51,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-24 13:00:51,450 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 702) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1579157240_17 at /127.0.0.1:48430 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/cluster_ed01d86c-dd99-6983-78c4-e5333a88d982/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/cluster_ed01d86c-dd99-6983-78c4-e5333a88d982/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/cluster_ed01d86c-dd99-6983-78c4-e5333a88d982/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:38931 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:34119 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1579157240_17 at /127.0.0.1:36796 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/cluster_ed01d86c-dd99-6983-78c4-e5333a88d982/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:34513 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/cluster_ed01d86c-dd99-6983-78c4-e5333a88d982/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-642162828_1 at /127.0.0.1:33208 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-642162828_1 at /127.0.0.1:36788 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1579157240_17 at /127.0.0.1:33236 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/cluster_ed01d86c-dd99-6983-78c4-e5333a88d982/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 894) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=150 (was 124) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 164) - ProcessCount LEAK? -, AvailableMemoryMB=7707 (was 8461) 2023-09-24 13:00:51,451 WARN [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-24 13:00:51,473 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=150, ProcessCount=167, AvailableMemoryMB=7707 2023-09-24 13:00:51,473 WARN [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-24 13:00:51,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 13:00:51,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-24 13:00:51,481 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 13:00:51,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-24 13:00:51,483 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 13:00:51,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-24 13:00:51,486 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05 2023-09-24 13:00:51,486 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85 2023-09-24 13:00:51,486 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05 empty. 2023-09-24 13:00:51,486 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85 empty. 2023-09-24 13:00:51,487 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05 2023-09-24 13:00:51,487 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85 2023-09-24 13:00:51,487 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-24 13:00:51,502 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-24 13:00:51,504 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => c3c16b775735c25839c472a8bf66dd05, NAME => 'testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp 2023-09-24 13:00:51,504 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => f6d5c1e57b9b703bf19471c9a916bb85, NAME => 'testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp 2023-09-24 13:00:51,525 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:00:51,526 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing c3c16b775735c25839c472a8bf66dd05, disabling compactions & flushes 2023-09-24 13:00:51,526 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:00:51,526 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:00:51,526 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. after waiting 0 ms 2023-09-24 13:00:51,526 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:00:51,526 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:00:51,526 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for c3c16b775735c25839c472a8bf66dd05: 2023-09-24 13:00:51,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:00:51,527 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing f6d5c1e57b9b703bf19471c9a916bb85, disabling compactions & flushes 2023-09-24 13:00:51,528 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. 2023-09-24 13:00:51,528 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. 2023-09-24 13:00:51,528 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. after waiting 0 ms 2023-09-24 13:00:51,528 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. 2023-09-24 13:00:51,528 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. 2023-09-24 13:00:51,528 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for f6d5c1e57b9b703bf19471c9a916bb85: 2023-09-24 13:00:51,531 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 13:00:51,532 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695560451531"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560451531"}]},"ts":"1695560451531"} 2023-09-24 13:00:51,532 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695560451531"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560451531"}]},"ts":"1695560451531"} 2023-09-24 13:00:51,535 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 13:00:51,536 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 13:00:51,536 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560451536"}]},"ts":"1695560451536"} 2023-09-24 13:00:51,538 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-24 13:00:51,545 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 13:00:51,546 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 13:00:51,546 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 13:00:51,546 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 13:00:51,546 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 13:00:51,546 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c3c16b775735c25839c472a8bf66dd05, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f6d5c1e57b9b703bf19471c9a916bb85, ASSIGN}] 2023-09-24 13:00:51,549 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f6d5c1e57b9b703bf19471c9a916bb85, ASSIGN 2023-09-24 13:00:51,549 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c3c16b775735c25839c472a8bf66dd05, ASSIGN 2023-09-24 13:00:51,550 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f6d5c1e57b9b703bf19471c9a916bb85, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35765,1695560427316; forceNewPlan=false, retain=false 2023-09-24 13:00:51,551 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c3c16b775735c25839c472a8bf66dd05, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44885,1695560427276; forceNewPlan=false, retain=false 2023-09-24 13:00:51,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-24 13:00:51,700 INFO [jenkins-hbase4:39481] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 13:00:51,703 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c3c16b775735c25839c472a8bf66dd05, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:51,703 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=f6d5c1e57b9b703bf19471c9a916bb85, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:51,703 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695560451703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560451703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560451703"}]},"ts":"1695560451703"} 2023-09-24 13:00:51,703 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695560451703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560451703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560451703"}]},"ts":"1695560451703"} 2023-09-24 13:00:51,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure c3c16b775735c25839c472a8bf66dd05, server=jenkins-hbase4.apache.org,44885,1695560427276}] 2023-09-24 13:00:51,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure f6d5c1e57b9b703bf19471c9a916bb85, server=jenkins-hbase4.apache.org,35765,1695560427316}] 2023-09-24 13:00:51,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-24 13:00:51,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:00:51,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c3c16b775735c25839c472a8bf66dd05, NAME => 'testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 13:00:51,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. service=AccessControlService 2023-09-24 13:00:51,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:00:51,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState c3c16b775735c25839c472a8bf66dd05 2023-09-24 13:00:51,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:00:51,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c3c16b775735c25839c472a8bf66dd05 2023-09-24 13:00:51,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c3c16b775735c25839c472a8bf66dd05 2023-09-24 13:00:51,866 INFO [StoreOpener-c3c16b775735c25839c472a8bf66dd05-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c3c16b775735c25839c472a8bf66dd05 2023-09-24 13:00:51,867 DEBUG [StoreOpener-c3c16b775735c25839c472a8bf66dd05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05/cf 2023-09-24 13:00:51,867 DEBUG [StoreOpener-c3c16b775735c25839c472a8bf66dd05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05/cf 2023-09-24 13:00:51,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. 2023-09-24 13:00:51,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f6d5c1e57b9b703bf19471c9a916bb85, NAME => 'testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 13:00:51,868 INFO [StoreOpener-c3c16b775735c25839c472a8bf66dd05-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3c16b775735c25839c472a8bf66dd05 columnFamilyName cf 2023-09-24 13:00:51,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. service=AccessControlService 2023-09-24 13:00:51,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:00:51,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState f6d5c1e57b9b703bf19471c9a916bb85 2023-09-24 13:00:51,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:00:51,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f6d5c1e57b9b703bf19471c9a916bb85 2023-09-24 13:00:51,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f6d5c1e57b9b703bf19471c9a916bb85 2023-09-24 13:00:51,870 INFO [StoreOpener-c3c16b775735c25839c472a8bf66dd05-1] regionserver.HStore(310): Store=c3c16b775735c25839c472a8bf66dd05/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:00:51,872 INFO [StoreOpener-f6d5c1e57b9b703bf19471c9a916bb85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f6d5c1e57b9b703bf19471c9a916bb85 2023-09-24 13:00:51,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05 2023-09-24 13:00:51,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05 2023-09-24 13:00:51,873 DEBUG [StoreOpener-f6d5c1e57b9b703bf19471c9a916bb85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85/cf 2023-09-24 13:00:51,873 DEBUG [StoreOpener-f6d5c1e57b9b703bf19471c9a916bb85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85/cf 2023-09-24 13:00:51,874 INFO [StoreOpener-f6d5c1e57b9b703bf19471c9a916bb85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6d5c1e57b9b703bf19471c9a916bb85 columnFamilyName cf 2023-09-24 13:00:51,875 INFO [StoreOpener-f6d5c1e57b9b703bf19471c9a916bb85-1] regionserver.HStore(310): Store=f6d5c1e57b9b703bf19471c9a916bb85/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:00:51,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85 2023-09-24 13:00:51,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c3c16b775735c25839c472a8bf66dd05 2023-09-24 13:00:51,878 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85 2023-09-24 13:00:51,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:00:51,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c3c16b775735c25839c472a8bf66dd05; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72779884, jitterRate=0.08450478315353394}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:00:51,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f6d5c1e57b9b703bf19471c9a916bb85 2023-09-24 13:00:51,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c3c16b775735c25839c472a8bf66dd05: 2023-09-24 13:00:51,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05., pid=30, masterSystemTime=1695560451859 2023-09-24 13:00:51,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:00:51,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f6d5c1e57b9b703bf19471c9a916bb85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66121936, jitterRate=-0.01470637321472168}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:00:51,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f6d5c1e57b9b703bf19471c9a916bb85: 2023-09-24 13:00:51,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:00:51,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:00:51,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85., pid=31, masterSystemTime=1695560451864 2023-09-24 13:00:51,885 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c3c16b775735c25839c472a8bf66dd05, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:51,885 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695560451885"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560451885"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560451885"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560451885"}]},"ts":"1695560451885"} 2023-09-24 13:00:51,888 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=f6d5c1e57b9b703bf19471c9a916bb85, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:51,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. 2023-09-24 13:00:51,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. 2023-09-24 13:00:51,890 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695560451888"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560451888"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560451888"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560451888"}]},"ts":"1695560451888"} 2023-09-24 13:00:51,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-24 13:00:51,895 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure c3c16b775735c25839c472a8bf66dd05, server=jenkins-hbase4.apache.org,44885,1695560427276 in 181 msec 2023-09-24 13:00:51,898 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c3c16b775735c25839c472a8bf66dd05, ASSIGN in 348 msec 2023-09-24 13:00:51,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-24 13:00:51,902 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure f6d5c1e57b9b703bf19471c9a916bb85, server=jenkins-hbase4.apache.org,35765,1695560427316 in 188 msec 2023-09-24 13:00:51,904 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-24 13:00:51,904 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f6d5c1e57b9b703bf19471c9a916bb85, ASSIGN in 356 msec 2023-09-24 13:00:51,905 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 13:00:51,905 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560451905"}]},"ts":"1695560451905"} 2023-09-24 13:00:51,907 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-24 13:00:51,909 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 13:00:51,910 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-24 13:00:51,912 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35765] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 13:00:51,913 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:00:51,913 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:00:51,913 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:00:51,913 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:00:51,915 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 13:00:51,915 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 13:00:51,915 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 13:00:51,915 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 13:00:51,917 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 438 msec 2023-09-24 13:00:52,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-24 13:00:52,087 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-24 13:00:52,091 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-24 13:00:52,091 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:00:52,092 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 13:00:52,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 13:00:52,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695560452108 (current time:1695560452108). 2023-09-24 13:00:52,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 13:00:52,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x127e6c4f to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:00:52,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19ef611a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:00:52,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:52,121 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:52,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x127e6c4f to 127.0.0.1:55856 2023-09-24 13:00:52,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:00:52,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x6f0a3861 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:00:52,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ef73ddb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:00:52,132 DEBUG [hconnection-0x6c727aae-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:52,135 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:52,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:52,140 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:52,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f0a3861 to 127.0.0.1:55856 2023-09-24 13:00:52,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:00:52,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 13:00:52,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 13:00:52,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 13:00:52,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 13:00:52,146 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 13:00:52,147 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695561052147 2023-09-24 13:00:52,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 13:00:52,147 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-24 13:00:52,149 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 13:00:52,149 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 13:00:52,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 13:00:52,150 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 13:00:52,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-24 13:00:52,152 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 13:00:52,153 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695561052153 2023-09-24 13:00:52,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,168 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-24 13:00:52,168 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:00:52,169 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-24 13:00:52,169 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-24 13:00:52,170 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,170 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,172 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:52,172 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:52,172 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:52,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:52,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:52,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:52,172 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:52,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:52,173 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,173 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:52,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,173 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,173 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 13:00:52,174 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,174 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,174 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-24 13:00:52,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-24 13:00:52,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-24 13:00:52,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,174 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 13:00:52,174 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 13:00:52,174 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 13:00:52,175 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,175 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 13:00:52,175 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,175 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,175 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 13:00:52,175 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 13:00:52,175 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:00:52,175 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:00:52,176 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 13:00:52,177 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 13:00:52,177 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-24 13:00:52,175 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:00:52,177 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-24 13:00:52,177 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-24 13:00:52,178 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-24 13:00:52,178 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 13:00:52,178 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-24 13:00:52,178 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-24 13:00:52,180 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,180 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:52,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:52,187 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,187 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:52,187 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,187 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:00:52,187 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,187 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:52,188 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:00:52,187 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,188 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:00:52,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:52,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-24 13:00:52,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@527cf3b5[Count = 1] remaining members to acquire global barrier 2023-09-24 13:00:52,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:52,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:52,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:52,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:52,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:52,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-24 13:00:52,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@527cf3b5[Count = 0] remaining members to acquire global barrier 2023-09-24 13:00:52,192 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-24 13:00:52,192 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,193 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,193 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,193 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,194 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 13:00:52,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,194 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-24 13:00:52,194 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40801,1695560427220' in zk 2023-09-24 13:00:52,194 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,194 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 13:00:52,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,194 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 13:00:52,194 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:00:52,194 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:00:52,194 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:00:52,194 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:00:52,194 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:00:52,194 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. started... 2023-09-24 13:00:52,195 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. 2023-09-24 13:00:52,195 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,195 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 13:00:52,195 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. started... 2023-09-24 13:00:52,195 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c3c16b775735c25839c472a8bf66dd05: 2023-09-24 13:00:52,196 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f6d5c1e57b9b703bf19471c9a916bb85: 2023-09-24 13:00:52,196 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,196 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 13:00:52,197 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,197 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:00:52,197 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:00:52,197 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:00:52,198 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 13:00:52,197 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-24 13:00:52,198 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 13:00:52,224 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. completed. 2023-09-24 13:00:52,224 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:00:52,224 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:00:52,224 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:00:52,224 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,224 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-24 13:00:52,224 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44885,1695560427276' in zk 2023-09-24 13:00:52,224 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. completed. 2023-09-24 13:00:52,224 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. 2023-09-24 13:00:52,224 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:00:52,225 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:00:52,225 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,225 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-24 13:00:52,225 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35765,1695560427316' in zk 2023-09-24 13:00:52,228 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 13:00:52,228 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,228 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:00:52,228 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-24 13:00:52,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:52,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:52,230 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,230 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 13:00:52,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:52,230 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:00:52,231 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-24 13:00:52,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:52,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:52,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44885,1695560427276': 2023-09-24 13:00:52,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-24 13:00:52,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:52,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:52,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:52,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:52,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:52,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35765,1695560427316': 2023-09-24 13:00:52,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-24 13:00:52,240 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-24 13:00:52,240 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 13:00:52,240 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 13:00:52,240 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,240 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 13:00:52,242 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,242 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,242 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:52,242 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:52,242 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,242 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:52,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:52,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,243 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,243 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:52,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:52,243 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:52,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:52,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:52,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:52,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:52,244 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:52,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:52,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,246 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,247 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,247 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,249 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:00:52,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 13:00:52,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-24 13:00:52,250 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 13:00:52,252 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:52,252 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:52,252 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:52,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:52,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:52,252 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:52,252 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:52,252 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,253 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:52,253 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-24 13:00:52,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:52,252 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:52,252 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:00:52,252 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:52,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:52,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:52,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:52,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:52,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 13:00:52,253 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:52,255 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,255 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,255 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,255 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:52,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:52,255 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,256 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,256 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,256 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 13:00:52,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,320 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-24 13:00:52,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,321 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-24 13:00:52,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695560452147Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695560452266 (+119 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695560452266Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695560452266Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695560452302 (+36 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695560452312 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695560452320 (+8 ms) 2023-09-24 13:00:52,324 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 13:00:52,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 177 msec 2023-09-24 13:00:52,451 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:00:52,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 13:00:52,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 13:00:52,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44885] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 13:00:52,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35765] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 13:00:52,468 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-24 13:00:52,468 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:00:52,469 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 13:00:52,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 13:00:52,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695560452482 (current time:1695560452482). 2023-09-24 13:00:52,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 13:00:52,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x37ab0262 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:00:52,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2336e182, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:00:52,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:52,496 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:52,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37ab0262 to 127.0.0.1:55856 2023-09-24 13:00:52,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:00:52,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x63c618a0 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:00:52,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18bf7459, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:00:52,509 DEBUG [hconnection-0x1b80d687-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:52,510 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:52,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:00:52,518 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:00:52,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63c618a0 to 127.0.0.1:55856 2023-09-24 13:00:52,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:00:52,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 13:00:52,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 13:00:52,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 13:00:52,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 13:00:52,524 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 13:00:52,526 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695561052526 2023-09-24 13:00:52,526 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-24 13:00:52,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 13:00:52,527 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 13:00:52,527 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 13:00:52,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 13:00:52,530 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-24 13:00:52,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-09-24 13:00:52,533 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 13:00:52,534 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695561052534 2023-09-24 13:00:52,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-24 13:00:52,558 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-24 13:00:52,558 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:00:52,560 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-24 13:00:52,560 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-24 13:00:52,560 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,560 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,562 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:52,562 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:52,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:52,562 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,562 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:52,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:52,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:52,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:52,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:52,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:52,562 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,562 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,563 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,563 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 13:00:52,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-24 13:00:52,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-24 13:00:52,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,564 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 13:00:52,564 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 13:00:52,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-24 13:00:52,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-24 13:00:52,564 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 13:00:52,564 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:00:52,564 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 13:00:52,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-24 13:00:52,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,564 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:00:52,564 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-24 13:00:52,566 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 13:00:52,566 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-24 13:00:52,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-24 13:00:52,566 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 13:00:52,566 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-24 13:00:52,566 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-24 13:00:52,566 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-24 13:00:52,566 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:00:52,566 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-24 13:00:52,567 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-24 13:00:52,567 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-24 13:00:52,567 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-24 13:00:52,574 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,574 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,574 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:52,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:52,574 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,575 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,575 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,575 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:00:52,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:52,575 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,575 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:00:52,575 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,575 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:00:52,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:52,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 13:00:52,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:52,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-24 13:00:52,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4264c609[Count = 1] remaining members to acquire global barrier 2023-09-24 13:00:52,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:52,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:52,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:52,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:52,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 13:00:52,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:52,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-24 13:00:52,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4264c609[Count = 0] remaining members to acquire global barrier 2023-09-24 13:00:52,580 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-24 13:00:52,580 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,581 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,581 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,581 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,581 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 13:00:52,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,581 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,582 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:00:52,582 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:00:52,582 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. 2023-09-24 13:00:52,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,582 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,582 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 13:00:52,582 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 13:00:52,582 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. started... 2023-09-24 13:00:52,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,582 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:00:52,582 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:00:52,582 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:00:52,582 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. started... 2023-09-24 13:00:52,582 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-24 13:00:52,582 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-24 13:00:52,582 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40801,1695560427220' in zk 2023-09-24 13:00:52,582 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f6d5c1e57b9b703bf19471c9a916bb85 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-24 13:00:52,582 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c3c16b775735c25839c472a8bf66dd05 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-24 13:00:52,584 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 13:00:52,584 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:00:52,584 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-24 13:00:52,626 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230924abdadeada8514eedbfc0a84a35833a31 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230924abdadeada8514eedbfc0a84a35833a31 2023-09-24 13:00:52,628 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:00:52,628 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230924f94ffadef7c24344981be766ab1d3482 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230924f94ffadef7c24344981be766ab1d3482 2023-09-24 13:00:52,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 13:00:52,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-24 13:00:52,630 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 13:00:52,640 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05/.tmp/cf/5657b299606540efa563f70569b81d1e 2023-09-24 13:00:52,643 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85/.tmp/cf/e34a38fe9ab24ba8ab8e2e2664c9f97f 2023-09-24 13:00:52,648 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05/.tmp/cf/5657b299606540efa563f70569b81d1e as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05/cf/5657b299606540efa563f70569b81d1e 2023-09-24 13:00:52,650 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85/.tmp/cf/e34a38fe9ab24ba8ab8e2e2664c9f97f as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85/cf/e34a38fe9ab24ba8ab8e2e2664c9f97f 2023-09-24 13:00:52,654 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05/cf/5657b299606540efa563f70569b81d1e, entries=6, sequenceid=6, filesize=5.9 K 2023-09-24 13:00:52,655 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for c3c16b775735c25839c472a8bf66dd05 in 73ms, sequenceid=6, compaction requested=false 2023-09-24 13:00:52,656 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-24 13:00:52,656 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85/cf/e34a38fe9ab24ba8ab8e2e2664c9f97f, entries=44, sequenceid=6, filesize=12.3 K 2023-09-24 13:00:52,657 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c3c16b775735c25839c472a8bf66dd05: 2023-09-24 13:00:52,657 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-24 13:00:52,657 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:00:52,657 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05/cf/5657b299606540efa563f70569b81d1e] hfiles 2023-09-24 13:00:52,657 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05/cf/5657b299606540efa563f70569b81d1e for snapshot=snaptb0-testExportFileSystemState 2023-09-24 13:00:52,657 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for f6d5c1e57b9b703bf19471c9a916bb85 in 75ms, sequenceid=6, compaction requested=false 2023-09-24 13:00:52,659 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f6d5c1e57b9b703bf19471c9a916bb85: 2023-09-24 13:00:52,659 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-24 13:00:52,659 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:00:52,659 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85/cf/e34a38fe9ab24ba8ab8e2e2664c9f97f] hfiles 2023-09-24 13:00:52,660 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85/cf/e34a38fe9ab24ba8ab8e2e2664c9f97f for snapshot=snaptb0-testExportFileSystemState 2023-09-24 13:00:52,676 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. completed. 2023-09-24 13:00:52,676 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. completed. 2023-09-24 13:00:52,676 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. 2023-09-24 13:00:52,676 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:00:52,676 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:00:52,676 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:00:52,677 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:00:52,677 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,677 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:00:52,677 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,677 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-24 13:00:52,677 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-24 13:00:52,677 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35765,1695560427316' in zk 2023-09-24 13:00:52,677 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44885,1695560427276' in zk 2023-09-24 13:00:52,687 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 13:00:52,688 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,688 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:00:52,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:52,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:52,688 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-24 13:00:52,690 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-24 13:00:52,690 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,690 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:00:52,690 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-24 13:00:52,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:52,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:52,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 13:00:52,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 13:00:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35765,1695560427316': 2023-09-24 13:00:52,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-24 13:00:52,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:52,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:52,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:52,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:52,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 13:00:52,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:52,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 13:00:52,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,44885,1695560427276': 2023-09-24 13:00:52,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-24 13:00:52,699 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-24 13:00:52,699 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 13:00:52,699 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 13:00:52,699 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-24 13:00:52,699 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 13:00:52,700 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,701 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,700 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,701 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:52,701 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,701 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:52,701 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:52,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:52,701 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:00:52,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:00:52,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:52,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:52,702 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:52,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:52,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:00:52,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:52,704 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 13:00:52,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:00:52,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 13:00:52,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,706 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,706 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:00:52,707 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-24 13:00:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,711 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,711 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:52,711 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:52,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:52,711 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:52,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:52,711 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:52,711 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,711 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:00:52,711 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,711 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:00:52,711 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:00:52,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:52,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:52,711 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-24 13:00:52,711 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:00:52,714 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,714 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-24 13:00:52,715 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:00:52,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:00:52,715 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-24 13:00:52,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 13:00:52,715 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:00:52,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:52,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:52,715 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:00:52,715 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:52,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:52,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:00:52,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:00:52,715 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230924f94ffadef7c24344981be766ab1d3482, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230924abdadeada8514eedbfc0a84a35833a31] mob files 2023-09-24 13:00:52,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230924f94ffadef7c24344981be766ab1d3482 2023-09-24 13:00:52,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230924abdadeada8514eedbfc0a84a35833a31 2023-09-24 13:00:52,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-24 13:00:52,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,754 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-24 13:00:52,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,754 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695560452526Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695560452728 (+202 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695560452728Loading Region manifests for snaptb0-testExportFileSystemState at 1695560452728Writing data manifest for snaptb0-testExportFileSystemState at 1695560452732 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695560452743 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695560452754 (+11 ms) 2023-09-24 13:00:52,757 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-24 13:00:52,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 230 msec 2023-09-24 13:00:52,830 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:00:52,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 13:00:52,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 13:00:52,831 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560452831 2023-09-24 13:00:52,831 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36659, tgtDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560452831, rawTgtDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560452831, srcFsUri=hdfs://localhost:36659, srcDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:00:52,854 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36659, inputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:00:52,854 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_121597547_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560452831, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560452831/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,854 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36659, inputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68, snapshotDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-24 13:00:52,865 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560452831/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-24 13:00:52,887 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:52,888 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:52,889 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:52,889 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:53,788 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop-1660168222580438435.jar 2023-09-24 13:00:53,789 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:53,789 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:53,857 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop-3980620871998610719.jar 2023-09-24 13:00:53,858 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:53,858 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:53,859 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:53,859 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:53,859 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:53,860 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 13:00:53,860 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 13:00:53,860 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 13:00:53,861 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 13:00:53,861 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 13:00:53,862 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 13:00:53,862 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 13:00:53,863 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 13:00:53,863 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 13:00:53,863 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 13:00:53,864 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 13:00:53,865 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:00:53,865 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:00:53,866 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:00:53,866 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:00:53,867 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:00:53,867 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:00:53,868 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:00:54,329 WARN [Listener at jenkins-hbase4.apache.org/34119] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 13:00:54,332 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-24 13:00:54,335 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-24 13:00:55,612 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 13:00:55,612 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 13:00:55,618 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0001_000001 (auth:SIMPLE) 2023-09-24 13:00:56,422 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0002_000001 (auth:SIMPLE) 2023-09-24 13:00:56,737 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 13:01:00,508 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0002_000001 (auth:SIMPLE) 2023-09-24 13:01:02,739 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0002_000001 (auth:SIMPLE) 2023-09-24 13:01:05,926 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0002_000001 (auth:SIMPLE) 2023-09-24 13:01:07,537 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 13:01:07,538 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 13:01:07,546 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-24 13:01:07,546 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 13:01:07,547 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 13:01:07,547 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1579157240_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-24 13:01:07,547 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-24 13:01:07,547 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-24 13:01:07,547 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1579157240_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560452831/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560452831/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-24 13:01:07,548 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560452831/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-24 13:01:07,548 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560452831/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-24 13:01:07,555 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-24 13:01:07,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-24 13:01:07,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-24 13:01:07,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-24 13:01:07,560 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560467560"}]},"ts":"1695560467560"} 2023-09-24 13:01:07,561 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-24 13:01:07,563 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-24 13:01:07,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c3c16b775735c25839c472a8bf66dd05, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f6d5c1e57b9b703bf19471c9a916bb85, UNASSIGN}] 2023-09-24 13:01:07,566 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f6d5c1e57b9b703bf19471c9a916bb85, UNASSIGN 2023-09-24 13:01:07,566 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c3c16b775735c25839c472a8bf66dd05, UNASSIGN 2023-09-24 13:01:07,567 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f6d5c1e57b9b703bf19471c9a916bb85, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:07,567 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c3c16b775735c25839c472a8bf66dd05, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:07,567 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695560467567"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560467567"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560467567"}]},"ts":"1695560467567"} 2023-09-24 13:01:07,567 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695560467567"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560467567"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560467567"}]},"ts":"1695560467567"} 2023-09-24 13:01:07,569 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure c3c16b775735c25839c472a8bf66dd05, server=jenkins-hbase4.apache.org,44885,1695560427276}] 2023-09-24 13:01:07,569 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure f6d5c1e57b9b703bf19471c9a916bb85, server=jenkins-hbase4.apache.org,35765,1695560427316}] 2023-09-24 13:01:07,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-24 13:01:07,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c3c16b775735c25839c472a8bf66dd05 2023-09-24 13:01:07,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c3c16b775735c25839c472a8bf66dd05, disabling compactions & flushes 2023-09-24 13:01:07,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:01:07,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:01:07,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. after waiting 0 ms 2023-09-24 13:01:07,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:01:07,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f6d5c1e57b9b703bf19471c9a916bb85 2023-09-24 13:01:07,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f6d5c1e57b9b703bf19471c9a916bb85, disabling compactions & flushes 2023-09-24 13:01:07,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. 2023-09-24 13:01:07,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. 2023-09-24 13:01:07,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. after waiting 0 ms 2023-09-24 13:01:07,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. 2023-09-24 13:01:07,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 13:01:07,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 13:01:07,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:01:07,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05. 2023-09-24 13:01:07,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c3c16b775735c25839c472a8bf66dd05: 2023-09-24 13:01:07,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:01:07,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85. 2023-09-24 13:01:07,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f6d5c1e57b9b703bf19471c9a916bb85: 2023-09-24 13:01:07,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c3c16b775735c25839c472a8bf66dd05 2023-09-24 13:01:07,735 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=c3c16b775735c25839c472a8bf66dd05, regionState=CLOSED 2023-09-24 13:01:07,736 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695560467735"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560467735"}]},"ts":"1695560467735"} 2023-09-24 13:01:07,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f6d5c1e57b9b703bf19471c9a916bb85 2023-09-24 13:01:07,736 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f6d5c1e57b9b703bf19471c9a916bb85, regionState=CLOSED 2023-09-24 13:01:07,736 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695560467736"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560467736"}]},"ts":"1695560467736"} 2023-09-24 13:01:07,744 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-24 13:01:07,744 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure c3c16b775735c25839c472a8bf66dd05, server=jenkins-hbase4.apache.org,44885,1695560427276 in 173 msec 2023-09-24 13:01:07,745 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-24 13:01:07,745 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure f6d5c1e57b9b703bf19471c9a916bb85, server=jenkins-hbase4.apache.org,35765,1695560427316 in 174 msec 2023-09-24 13:01:07,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c3c16b775735c25839c472a8bf66dd05, UNASSIGN in 180 msec 2023-09-24 13:01:07,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-24 13:01:07,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f6d5c1e57b9b703bf19471c9a916bb85, UNASSIGN in 181 msec 2023-09-24 13:01:07,748 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560467748"}]},"ts":"1695560467748"} 2023-09-24 13:01:07,749 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-24 13:01:07,750 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-24 13:01:07,753 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 196 msec 2023-09-24 13:01:07,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-24 13:01:07,862 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-24 13:01:07,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-24 13:01:07,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 13:01:07,866 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 13:01:07,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-24 13:01:07,867 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 13:01:07,869 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35765] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-24 13:01:07,872 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05 2023-09-24 13:01:07,872 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85 2023-09-24 13:01:07,873 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 13:01:07,873 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 13:01:07,873 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 13:01:07,873 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 13:01:07,873 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-24 13:01:07,873 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-24 13:01:07,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-24 13:01:07,874 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-24 13:01:07,874 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 13:01:07,874 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 13:01:07,874 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:07,874 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:07,875 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 13:01:07,875 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:07,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-24 13:01:07,876 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-24 13:01:07,876 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:07,877 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05/cf, FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05/recovered.edits] 2023-09-24 13:01:07,877 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85/cf, FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85/recovered.edits] 2023-09-24 13:01:07,882 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85/cf/e34a38fe9ab24ba8ab8e2e2664c9f97f to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85/cf/e34a38fe9ab24ba8ab8e2e2664c9f97f 2023-09-24 13:01:07,883 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05/cf/5657b299606540efa563f70569b81d1e to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05/cf/5657b299606540efa563f70569b81d1e 2023-09-24 13:01:07,886 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85/recovered.edits/9.seqid to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85/recovered.edits/9.seqid 2023-09-24 13:01:07,887 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05/recovered.edits/9.seqid to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05/recovered.edits/9.seqid 2023-09-24 13:01:07,887 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/f6d5c1e57b9b703bf19471c9a916bb85 2023-09-24 13:01:07,887 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemState/c3c16b775735c25839c472a8bf66dd05 2023-09-24 13:01:07,887 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-24 13:01:07,888 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-24 13:01:07,889 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-24 13:01:07,893 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230924f94ffadef7c24344981be766ab1d3482 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230924f94ffadef7c24344981be766ab1d3482 2023-09-24 13:01:07,894 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230924abdadeada8514eedbfc0a84a35833a31 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230924abdadeada8514eedbfc0a84a35833a31 2023-09-24 13:01:07,895 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-24 13:01:07,897 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 13:01:07,900 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-24 13:01:07,902 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-24 13:01:07,903 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 13:01:07,903 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-24 13:01:07,903 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695560467903"}]},"ts":"9223372036854775807"} 2023-09-24 13:01:07,903 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695560467903"}]},"ts":"9223372036854775807"} 2023-09-24 13:01:07,906 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 13:01:07,906 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c3c16b775735c25839c472a8bf66dd05, NAME => 'testtb-testExportFileSystemState,,1695560451475.c3c16b775735c25839c472a8bf66dd05.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f6d5c1e57b9b703bf19471c9a916bb85, NAME => 'testtb-testExportFileSystemState,1,1695560451475.f6d5c1e57b9b703bf19471c9a916bb85.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 13:01:07,906 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-24 13:01:07,906 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695560467906"}]},"ts":"9223372036854775807"} 2023-09-24 13:01:07,908 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-24 13:01:07,910 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-24 13:01:07,911 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 47 msec 2023-09-24 13:01:07,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-24 13:01:07,977 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-24 13:01:07,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-24 13:01:07,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-24 13:01:07,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-24 13:01:07,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-24 13:01:08,020 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=762 (was 753) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1424086066_1 at /127.0.0.1:41078 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1579157240_17 at /127.0.0.1:41102 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1579157240_17 at /127.0.0.1:45056 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1965 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:37727 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:44331 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1579157240_17 at /127.0.0.1:49630 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1424086066_1 at /127.0.0.1:49616 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=940 (was 927) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=134 (was 150), ProcessCount=167 (was 167), AvailableMemoryMB=7530 (was 7707) 2023-09-24 13:01:08,020 WARN [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-24 13:01:08,042 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=940, MaxFileDescriptor=60000, SystemLoadAverage=134, ProcessCount=167, AvailableMemoryMB=7529 2023-09-24 13:01:08,043 WARN [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-24 13:01:08,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 13:01:08,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-24 13:01:08,048 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 13:01:08,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-24 13:01:08,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-24 13:01:08,050 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 13:01:08,052 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de 2023-09-24 13:01:08,052 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e 2023-09-24 13:01:08,053 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de empty. 2023-09-24 13:01:08,053 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e empty. 2023-09-24 13:01:08,053 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de 2023-09-24 13:01:08,053 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e 2023-09-24 13:01:08,053 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-24 13:01:08,064 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-24 13:01:08,066 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => c315132baef93eef3c835c428416a6de, NAME => 'testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp 2023-09-24 13:01:08,066 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 05be4f3d8c3d47397a87f5a5c979674e, NAME => 'testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp 2023-09-24 13:01:08,077 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:08,077 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing c315132baef93eef3c835c428416a6de, disabling compactions & flushes 2023-09-24 13:01:08,077 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:08,077 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:08,077 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. after waiting 0 ms 2023-09-24 13:01:08,077 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:08,078 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:08,078 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for c315132baef93eef3c835c428416a6de: 2023-09-24 13:01:08,080 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:08,080 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 05be4f3d8c3d47397a87f5a5c979674e, disabling compactions & flushes 2023-09-24 13:01:08,080 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. 2023-09-24 13:01:08,080 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. 2023-09-24 13:01:08,080 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. after waiting 0 ms 2023-09-24 13:01:08,080 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. 2023-09-24 13:01:08,080 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. 2023-09-24 13:01:08,080 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 05be4f3d8c3d47397a87f5a5c979674e: 2023-09-24 13:01:08,082 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 13:01:08,083 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695560468083"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560468083"}]},"ts":"1695560468083"} 2023-09-24 13:01:08,084 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695560468083"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560468083"}]},"ts":"1695560468083"} 2023-09-24 13:01:08,086 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 13:01:08,087 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 13:01:08,087 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560468087"}]},"ts":"1695560468087"} 2023-09-24 13:01:08,088 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-24 13:01:08,092 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 13:01:08,093 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 13:01:08,094 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 13:01:08,094 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 13:01:08,094 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 13:01:08,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c315132baef93eef3c835c428416a6de, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=05be4f3d8c3d47397a87f5a5c979674e, ASSIGN}] 2023-09-24 13:01:08,097 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=05be4f3d8c3d47397a87f5a5c979674e, ASSIGN 2023-09-24 13:01:08,097 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c315132baef93eef3c835c428416a6de, ASSIGN 2023-09-24 13:01:08,098 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=05be4f3d8c3d47397a87f5a5c979674e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35765,1695560427316; forceNewPlan=false, retain=false 2023-09-24 13:01:08,098 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c315132baef93eef3c835c428416a6de, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44885,1695560427276; forceNewPlan=false, retain=false 2023-09-24 13:01:08,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-24 13:01:08,248 INFO [jenkins-hbase4:39481] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 13:01:08,251 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c315132baef93eef3c835c428416a6de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,251 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=05be4f3d8c3d47397a87f5a5c979674e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,251 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695560468251"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560468251"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560468251"}]},"ts":"1695560468251"} 2023-09-24 13:01:08,251 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695560468251"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560468251"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560468251"}]},"ts":"1695560468251"} 2023-09-24 13:01:08,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure c315132baef93eef3c835c428416a6de, server=jenkins-hbase4.apache.org,44885,1695560427276}] 2023-09-24 13:01:08,254 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 05be4f3d8c3d47397a87f5a5c979674e, server=jenkins-hbase4.apache.org,35765,1695560427316}] 2023-09-24 13:01:08,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-24 13:01:08,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:08,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. 2023-09-24 13:01:08,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c315132baef93eef3c835c428416a6de, NAME => 'testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 13:01:08,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 05be4f3d8c3d47397a87f5a5c979674e, NAME => 'testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 13:01:08,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. service=AccessControlService 2023-09-24 13:01:08,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. service=AccessControlService 2023-09-24 13:01:08,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:01:08,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:01:08,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 05be4f3d8c3d47397a87f5a5c979674e 2023-09-24 13:01:08,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports c315132baef93eef3c835c428416a6de 2023-09-24 13:01:08,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:08,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:08,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 05be4f3d8c3d47397a87f5a5c979674e 2023-09-24 13:01:08,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c315132baef93eef3c835c428416a6de 2023-09-24 13:01:08,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 05be4f3d8c3d47397a87f5a5c979674e 2023-09-24 13:01:08,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c315132baef93eef3c835c428416a6de 2023-09-24 13:01:08,411 INFO [StoreOpener-05be4f3d8c3d47397a87f5a5c979674e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 05be4f3d8c3d47397a87f5a5c979674e 2023-09-24 13:01:08,411 INFO [StoreOpener-c315132baef93eef3c835c428416a6de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c315132baef93eef3c835c428416a6de 2023-09-24 13:01:08,412 DEBUG [StoreOpener-05be4f3d8c3d47397a87f5a5c979674e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e/cf 2023-09-24 13:01:08,412 DEBUG [StoreOpener-c315132baef93eef3c835c428416a6de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de/cf 2023-09-24 13:01:08,412 DEBUG [StoreOpener-05be4f3d8c3d47397a87f5a5c979674e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e/cf 2023-09-24 13:01:08,412 DEBUG [StoreOpener-c315132baef93eef3c835c428416a6de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de/cf 2023-09-24 13:01:08,413 INFO [StoreOpener-c315132baef93eef3c835c428416a6de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c315132baef93eef3c835c428416a6de columnFamilyName cf 2023-09-24 13:01:08,413 INFO [StoreOpener-05be4f3d8c3d47397a87f5a5c979674e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05be4f3d8c3d47397a87f5a5c979674e columnFamilyName cf 2023-09-24 13:01:08,414 INFO [StoreOpener-05be4f3d8c3d47397a87f5a5c979674e-1] regionserver.HStore(310): Store=05be4f3d8c3d47397a87f5a5c979674e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:01:08,414 INFO [StoreOpener-c315132baef93eef3c835c428416a6de-1] regionserver.HStore(310): Store=c315132baef93eef3c835c428416a6de/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:01:08,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e 2023-09-24 13:01:08,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de 2023-09-24 13:01:08,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e 2023-09-24 13:01:08,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de 2023-09-24 13:01:08,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 05be4f3d8c3d47397a87f5a5c979674e 2023-09-24 13:01:08,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c315132baef93eef3c835c428416a6de 2023-09-24 13:01:08,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:01:08,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:01:08,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 05be4f3d8c3d47397a87f5a5c979674e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74313589, jitterRate=0.10735876858234406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:01:08,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c315132baef93eef3c835c428416a6de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74135084, jitterRate=0.10469883680343628}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:01:08,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 05be4f3d8c3d47397a87f5a5c979674e: 2023-09-24 13:01:08,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c315132baef93eef3c835c428416a6de: 2023-09-24 13:01:08,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de., pid=45, masterSystemTime=1695560468405 2023-09-24 13:01:08,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e., pid=46, masterSystemTime=1695560468405 2023-09-24 13:01:08,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:08,425 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:08,425 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=c315132baef93eef3c835c428416a6de, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,426 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695560468425"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560468425"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560468425"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560468425"}]},"ts":"1695560468425"} 2023-09-24 13:01:08,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. 2023-09-24 13:01:08,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. 2023-09-24 13:01:08,426 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=05be4f3d8c3d47397a87f5a5c979674e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,426 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695560468426"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560468426"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560468426"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560468426"}]},"ts":"1695560468426"} 2023-09-24 13:01:08,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-24 13:01:08,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure c315132baef93eef3c835c428416a6de, server=jenkins-hbase4.apache.org,44885,1695560427276 in 174 msec 2023-09-24 13:01:08,430 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-24 13:01:08,430 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 05be4f3d8c3d47397a87f5a5c979674e, server=jenkins-hbase4.apache.org,35765,1695560427316 in 174 msec 2023-09-24 13:01:08,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c315132baef93eef3c835c428416a6de, ASSIGN in 335 msec 2023-09-24 13:01:08,432 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-24 13:01:08,433 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=05be4f3d8c3d47397a87f5a5c979674e, ASSIGN in 336 msec 2023-09-24 13:01:08,433 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 13:01:08,433 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560468433"}]},"ts":"1695560468433"} 2023-09-24 13:01:08,434 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-24 13:01:08,437 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 13:01:08,437 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-24 13:01:08,438 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35765] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-24 13:01:08,440 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:08,440 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:08,440 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:08,440 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:08,441 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:08,441 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:08,441 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:08,442 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:08,443 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 396 msec 2023-09-24 13:01:08,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-24 13:01:08,653 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-24 13:01:08,656 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-24 13:01:08,656 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:08,657 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 13:01:08,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 13:01:08,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695560468669 (current time:1695560468669). 2023-09-24 13:01:08,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 13:01:08,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x6ab9ab83 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:01:08,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65bad1af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:01:08,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:08,681 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:08,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ab9ab83 to 127.0.0.1:55856 2023-09-24 13:01:08,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:01:08,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x7bf3c17c to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:01:08,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cb18832, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:01:08,692 DEBUG [hconnection-0x6fb51da2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:08,695 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:08,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:08,702 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:08,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7bf3c17c to 127.0.0.1:55856 2023-09-24 13:01:08,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:01:08,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-24 13:01:08,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 13:01:08,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 13:01:08,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 13:01:08,707 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 13:01:08,708 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695561068708 2023-09-24 13:01:08,708 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-24 13:01:08,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 13:01:08,709 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 13:01:08,709 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 13:01:08,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 13:01:08,710 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 13:01:08,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-24 13:01:08,713 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 13:01:08,714 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695561068714 2023-09-24 13:01:08,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,724 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-24 13:01:08,724 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:08,725 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-24 13:01:08,725 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-24 13:01:08,725 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,725 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,728 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,728 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:08,728 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:08,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:08,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:08,728 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:08,728 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:08,728 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,728 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,729 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 13:01:08,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-24 13:01:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-24 13:01:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,729 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 13:01:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-24 13:01:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,729 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 13:01:08,729 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 13:01:08,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,729 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 13:01:08,729 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:08,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,730 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 13:01:08,731 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-24 13:01:08,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,731 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-24 13:01:08,731 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 13:01:08,731 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:08,731 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 13:01:08,732 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:08,732 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 13:01:08,734 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-24 13:01:08,734 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 13:01:08,735 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-24 13:01:08,735 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-24 13:01:08,735 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-24 13:01:08,736 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,737 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,737 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,737 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,737 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,737 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,737 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:08,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:08,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:08,737 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,737 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,737 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:08,737 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:08,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:08,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:08,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-24 13:01:08,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9a848a5[Count = 1] remaining members to acquire global barrier 2023-09-24 13:01:08,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:08,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:08,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:08,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:08,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:08,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:08,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-24 13:01:08,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9a848a5[Count = 0] remaining members to acquire global barrier 2023-09-24 13:01:08,741 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-24 13:01:08,741 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,742 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,742 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,742 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,743 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,743 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 13:01:08,743 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 13:01:08,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,743 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 13:01:08,743 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-24 13:01:08,743 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40801,1695560427220' in zk 2023-09-24 13:01:08,743 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,743 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 13:01:08,743 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:01:08,743 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:01:08,743 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:01:08,743 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:01:08,743 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:08,743 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. 2023-09-24 13:01:08,743 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. started... 2023-09-24 13:01:08,743 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. started... 2023-09-24 13:01:08,744 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c315132baef93eef3c835c428416a6de: 2023-09-24 13:01:08,744 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 05be4f3d8c3d47397a87f5a5c979674e: 2023-09-24 13:01:08,745 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,745 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,745 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:01:08,745 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:01:08,745 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 13:01:08,745 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 13:01:08,754 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 13:01:08,754 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:08,754 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-24 13:01:08,761 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. completed. 2023-09-24 13:01:08,761 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:08,761 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:01:08,761 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:01:08,761 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. completed. 2023-09-24 13:01:08,761 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,761 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. 2023-09-24 13:01:08,762 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-24 13:01:08,762 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44885,1695560427276' in zk 2023-09-24 13:01:08,762 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:01:08,762 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:01:08,762 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,762 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-24 13:01:08,762 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35765,1695560427316' in zk 2023-09-24 13:01:08,763 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 13:01:08,763 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,763 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:08,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:08,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:08,764 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-24 13:01:08,765 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 13:01:08,765 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,765 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:08,765 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-24 13:01:08,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:08,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:08,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:08,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:08,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:08,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44885,1695560427276': 2023-09-24 13:01:08,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-24 13:01:08,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:08,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:08,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:08,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:08,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:08,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:08,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:08,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35765,1695560427316': 2023-09-24 13:01:08,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-24 13:01:08,774 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-24 13:01:08,774 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 13:01:08,774 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 13:01:08,774 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,774 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 13:01:08,775 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,775 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,775 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,775 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,776 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:08,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:08,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:08,775 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:08,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,775 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:08,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:08,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:08,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:08,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,776 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:08,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:08,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:08,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:08,777 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:08,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:08,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,778 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:08,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:08,779 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,780 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:08,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,780 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:08,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,785 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,785 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:08,785 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:08,785 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:08,785 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:08,785 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:08,785 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,785 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:08,785 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:08,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:08,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:08,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:08,785 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:08,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:08,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,785 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:08,786 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-24 13:01:08,785 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:08,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 13:01:08,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:08,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:08,787 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:08,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:08,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:08,787 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,787 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:08,787 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:08,787 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,787 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:08,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:08,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 13:01:08,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,809 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:01:08,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-24 13:01:08,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-24 13:01:08,811 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 13:01:08,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,816 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-24 13:01:08,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,817 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:08,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695560468708Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695560468796 (+88 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695560468796Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695560468796Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695560468799 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695560468810 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695560468816 (+6 ms) 2023-09-24 13:01:08,822 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 13:01:08,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 113 msec 2023-09-24 13:01:09,011 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:01:09,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-24 13:01:09,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 13:01:09,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44885] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 13:01:09,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35765] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 13:01:09,020 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-24 13:01:09,020 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:09,020 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 13:01:09,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 13:01:09,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695560469030 (current time:1695560469030). 2023-09-24 13:01:09,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 13:01:09,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x14dec2ec to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:01:09,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56e5342, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:01:09,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:09,046 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:09,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14dec2ec to 127.0.0.1:55856 2023-09-24 13:01:09,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:01:09,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x3828c4f0 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:01:09,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a03a8bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:01:09,057 DEBUG [hconnection-0x2d8004fa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:09,059 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:09,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:09,064 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38316, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:09,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3828c4f0 to 127.0.0.1:55856 2023-09-24 13:01:09,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:01:09,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-24 13:01:09,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 13:01:09,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 13:01:09,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 13:01:09,069 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 13:01:09,070 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695561069070 2023-09-24 13:01:09,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-24 13:01:09,070 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-24 13:01:09,071 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 13:01:09,071 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 13:01:09,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 13:01:09,073 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-24 13:01:09,074 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-24 13:01:09,075 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 13:01:09,076 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695561069076 2023-09-24 13:01:09,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-24 13:01:09,091 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-24 13:01:09,091 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:09,093 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-24 13:01:09,093 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-24 13:01:09,094 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,094 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,095 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,095 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:09,095 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:09,096 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:09,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:09,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:09,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:09,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:09,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:09,096 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:09,096 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,097 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,097 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 13:01:09,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-24 13:01:09,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-24 13:01:09,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-24 13:01:09,098 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 13:01:09,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,098 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 13:01:09,098 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-24 13:01:09,098 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-24 13:01:09,098 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-24 13:01:09,098 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 13:01:09,098 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-24 13:01:09,098 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:09,098 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 13:01:09,098 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-24 13:01:09,100 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 13:01:09,100 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-24 13:01:09,099 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:09,100 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-24 13:01:09,100 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:09,101 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 13:01:09,101 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-24 13:01:09,101 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-24 13:01:09,102 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-24 13:01:09,103 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-24 13:01:09,103 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-24 13:01:09,104 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,104 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,104 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:09,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:09,106 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,106 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:09,106 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,106 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,106 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:09,106 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:09,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:09,106 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,106 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:09,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 13:01:09,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:09,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:09,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-24 13:01:09,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@182c0d43[Count = 1] remaining members to acquire global barrier 2023-09-24 13:01:09,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:09,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 13:01:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:09,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:09,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-24 13:01:09,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@182c0d43[Count = 0] remaining members to acquire global barrier 2023-09-24 13:01:09,110 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-24 13:01:09,110 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,111 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,111 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,112 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,112 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 13:01:09,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,112 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 13:01:09,112 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-24 13:01:09,112 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. 2023-09-24 13:01:09,112 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-24 13:01:09,112 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:01:09,112 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:01:09,112 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,112 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40801,1695560427220' in zk 2023-09-24 13:01:09,112 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. started... 2023-09-24 13:01:09,113 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,113 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 13:01:09,113 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 05be4f3d8c3d47397a87f5a5c979674e 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-24 13:01:09,114 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 13:01:09,114 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:09,114 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-24 13:01:09,118 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:01:09,118 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:09,118 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:01:09,118 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. started... 2023-09-24 13:01:09,118 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c315132baef93eef3c835c428416a6de 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-24 13:01:09,149 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309242f2308a7895345cf9a7f46e74406c47c to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309242f2308a7895345cf9a7f46e74406c47c 2023-09-24 13:01:09,154 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092444b30d02a3fe44f28b301f5cbd4c5a44 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023092444b30d02a3fe44f28b301f5cbd4c5a44 2023-09-24 13:01:09,161 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e/.tmp/cf/0b9cf4867460415e96cf713b5118cfe2 2023-09-24 13:01:09,162 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de/.tmp/cf/be88337636b249e5bb8d4317056b256c 2023-09-24 13:01:09,167 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e/.tmp/cf/0b9cf4867460415e96cf713b5118cfe2 as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e/cf/0b9cf4867460415e96cf713b5118cfe2 2023-09-24 13:01:09,168 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de/.tmp/cf/be88337636b249e5bb8d4317056b256c as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de/cf/be88337636b249e5bb8d4317056b256c 2023-09-24 13:01:09,172 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:01:09,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-24 13:01:09,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-24 13:01:09,173 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 13:01:09,173 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de/cf/be88337636b249e5bb8d4317056b256c, entries=4, sequenceid=6, filesize=5.5 K 2023-09-24 13:01:09,173 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e/cf/0b9cf4867460415e96cf713b5118cfe2, entries=46, sequenceid=6, filesize=12.5 K 2023-09-24 13:01:09,174 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for c315132baef93eef3c835c428416a6de in 56ms, sequenceid=6, compaction requested=false 2023-09-24 13:01:09,174 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 05be4f3d8c3d47397a87f5a5c979674e in 61ms, sequenceid=6, compaction requested=false 2023-09-24 13:01:09,174 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-24 13:01:09,174 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-24 13:01:09,177 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c315132baef93eef3c835c428416a6de: 2023-09-24 13:01:09,177 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 05be4f3d8c3d47397a87f5a5c979674e: 2023-09-24 13:01:09,177 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-24 13:01:09,177 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-24 13:01:09,177 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:01:09,177 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:01:09,177 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e/cf/0b9cf4867460415e96cf713b5118cfe2] hfiles 2023-09-24 13:01:09,177 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e/cf/0b9cf4867460415e96cf713b5118cfe2 for snapshot=snaptb0-testConsecutiveExports 2023-09-24 13:01:09,177 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de/cf/be88337636b249e5bb8d4317056b256c] hfiles 2023-09-24 13:01:09,177 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de/cf/be88337636b249e5bb8d4317056b256c for snapshot=snaptb0-testConsecutiveExports 2023-09-24 13:01:09,189 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. completed. 2023-09-24 13:01:09,189 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:09,189 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:01:09,189 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:01:09,189 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,189 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-24 13:01:09,189 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,44885,1695560427276' in zk 2023-09-24 13:01:09,190 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. completed. 2023-09-24 13:01:09,190 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. 2023-09-24 13:01:09,190 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:01:09,190 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:01:09,190 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,190 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-24 13:01:09,190 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35765,1695560427316' in zk 2023-09-24 13:01:09,191 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,191 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 13:01:09,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:09,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:09,191 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:09,191 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-24 13:01:09,193 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,193 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-24 13:01:09,193 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:09,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:09,193 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-24 13:01:09,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:09,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 13:01:09,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:09,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 13:01:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,44885,1695560427276': 2023-09-24 13:01:09,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-24 13:01:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:09,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:09,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:09,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 13:01:09,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:09,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:09,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 13:01:09,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:09,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35765,1695560427316': 2023-09-24 13:01:09,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-24 13:01:09,202 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-24 13:01:09,202 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 13:01:09,202 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 13:01:09,202 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-24 13:01:09,202 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 13:01:09,203 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,203 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,203 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:09,203 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,203 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:09,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:09,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:09,203 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:09,204 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,204 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:09,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:09,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:09,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:09,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:09,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:09,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:09,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,205 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:09,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 13:01:09,205 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:09,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 13:01:09,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:09,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,207 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,207 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:09,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:09,209 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-24 13:01:09,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:09,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,215 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:09,215 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:09,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:09,215 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,215 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:09,215 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:09,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:09,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:09,215 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:09,215 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-24 13:01:09,215 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:09,215 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:09,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:09,217 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:09,217 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-24 13:01:09,215 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:09,218 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-24 13:01:09,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:09,218 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:09,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 13:01:09,218 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:09,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:09,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:09,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:09,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:09,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:09,218 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,218 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:09,218 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:09,218 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,218 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309242f2308a7895345cf9a7f46e74406c47c, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023092444b30d02a3fe44f28b301f5cbd4c5a44] mob files 2023-09-24 13:01:09,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309242f2308a7895345cf9a7f46e74406c47c 2023-09-24 13:01:09,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023092444b30d02a3fe44f28b301f5cbd4c5a44 2023-09-24 13:01:09,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-24 13:01:09,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,251 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-24 13:01:09,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,251 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695560469070Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695560469230 (+160 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695560469230Loading Region manifests for snaptb0-testConsecutiveExports at 1695560469230Writing data manifest for snaptb0-testConsecutiveExports at 1695560469235 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695560469243 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695560469251 (+8 ms) 2023-09-24 13:01:09,254 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-24 13:01:09,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 183 msec 2023-09-24 13:01:09,373 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:01:09,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-24 13:01:09,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 13:01:09,375 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375 2023-09-24 13:01:09,375 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375, srcFsUri=hdfs://localhost:36659, srcDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:01:09,397 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36659, inputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:01:09,397 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@2b68c7dd, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,397 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36659, inputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68, snapshotDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-24 13:01:09,405 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 13:01:09,417 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:09,417 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:09,419 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:09,419 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:10,300 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop-3779085659546050624.jar 2023-09-24 13:01:10,301 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:10,302 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:10,369 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop-4470658116046316715.jar 2023-09-24 13:01:10,370 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:10,370 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:10,370 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:10,371 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:10,371 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:10,372 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:10,372 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 13:01:10,372 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 13:01:10,373 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 13:01:10,373 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 13:01:10,374 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 13:01:10,374 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 13:01:10,375 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 13:01:10,375 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 13:01:10,375 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 13:01:10,376 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 13:01:10,377 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:01:10,377 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:01:10,378 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:01:10,379 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:01:10,379 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:01:10,380 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:01:10,381 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:01:10,782 WARN [Listener at jenkins-hbase4.apache.org/34119] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 13:01:10,784 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-24 13:01:10,786 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-24 13:01:12,101 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 13:01:12,102 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 13:01:12,104 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0002_000001 (auth:SIMPLE) 2023-09-24 13:01:12,914 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0003_000001 (auth:SIMPLE) 2023-09-24 13:01:13,310 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 13:01:16,636 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0003_000001 (auth:SIMPLE) 2023-09-24 13:01:18,857 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0003_000001 (auth:SIMPLE) 2023-09-24 13:01:21,196 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0003_000001 (auth:SIMPLE) 2023-09-24 13:01:22,954 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 13:01:22,954 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 13:01:22,958 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-24 13:01:22,959 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 13:01:22,959 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 13:01:22,959 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1579157240_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-24 13:01:22,962 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-24 13:01:22,962 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-24 13:01:22,962 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3ace7065 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-24 13:01:22,963 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-24 13:01:22,963 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-24 13:01:22,964 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375, srcFsUri=hdfs://localhost:36659, srcDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:01:22,985 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36659, inputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:01:22,985 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@387b3a74, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 13:01:22,985 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36659, inputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68, snapshotDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-24 13:01:22,996 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-24 13:01:23,007 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:23,008 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:23,008 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:23,008 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:23,877 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop-703563894319809087.jar 2023-09-24 13:01:23,877 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:23,878 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:23,944 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop-8893320486732043441.jar 2023-09-24 13:01:23,945 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:23,945 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:23,946 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:23,946 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:23,946 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:23,947 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:23,947 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 13:01:23,948 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 13:01:23,948 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 13:01:23,948 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 13:01:23,949 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 13:01:23,949 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 13:01:23,950 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 13:01:23,950 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 13:01:23,950 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 13:01:23,951 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 13:01:23,951 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:01:23,952 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:01:23,952 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:01:23,952 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:01:23,953 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:01:23,953 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:01:23,954 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:01:24,301 WARN [Listener at jenkins-hbase4.apache.org/34119] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 13:01:24,304 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-24 13:01:24,306 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-24 13:01:27,371 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 13:01:27,371 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 13:01:27,374 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0003_000001 (auth:SIMPLE) 2023-09-24 13:01:28,113 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0004_000001 (auth:SIMPLE) 2023-09-24 13:01:31,865 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0004_000001 (auth:SIMPLE) 2023-09-24 13:01:34,079 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0004_000001 (auth:SIMPLE) 2023-09-24 13:01:36,347 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0004_000001 (auth:SIMPLE) 2023-09-24 13:01:37,458 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 13:01:37,458 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 13:01:37,461 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-24 13:01:37,461 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 13:01:37,462 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 13:01:37,462 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1579157240_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-24 13:01:37,466 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-24 13:01:37,466 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-24 13:01:37,466 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3ace7065 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-24 13:01:37,466 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-24 13:01:37,466 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/local-export-1695560469375/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-24 13:01:37,478 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-24 13:01:37,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-24 13:01:37,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-24 13:01:37,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-24 13:01:37,484 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560497484"}]},"ts":"1695560497484"} 2023-09-24 13:01:37,485 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-24 13:01:37,487 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-24 13:01:37,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c315132baef93eef3c835c428416a6de, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=05be4f3d8c3d47397a87f5a5c979674e, UNASSIGN}] 2023-09-24 13:01:37,490 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=05be4f3d8c3d47397a87f5a5c979674e, UNASSIGN 2023-09-24 13:01:37,490 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c315132baef93eef3c835c428416a6de, UNASSIGN 2023-09-24 13:01:37,491 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=05be4f3d8c3d47397a87f5a5c979674e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:37,491 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=c315132baef93eef3c835c428416a6de, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:37,491 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695560497491"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560497491"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560497491"}]},"ts":"1695560497491"} 2023-09-24 13:01:37,491 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695560497491"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560497491"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560497491"}]},"ts":"1695560497491"} 2023-09-24 13:01:37,493 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 05be4f3d8c3d47397a87f5a5c979674e, server=jenkins-hbase4.apache.org,35765,1695560427316}] 2023-09-24 13:01:37,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure c315132baef93eef3c835c428416a6de, server=jenkins-hbase4.apache.org,44885,1695560427276}] 2023-09-24 13:01:37,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-24 13:01:37,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 05be4f3d8c3d47397a87f5a5c979674e 2023-09-24 13:01:37,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c315132baef93eef3c835c428416a6de 2023-09-24 13:01:37,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 05be4f3d8c3d47397a87f5a5c979674e, disabling compactions & flushes 2023-09-24 13:01:37,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c315132baef93eef3c835c428416a6de, disabling compactions & flushes 2023-09-24 13:01:37,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. 2023-09-24 13:01:37,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:37,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. 2023-09-24 13:01:37,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:37,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. after waiting 0 ms 2023-09-24 13:01:37,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. 2023-09-24 13:01:37,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. after waiting 0 ms 2023-09-24 13:01:37,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:37,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 13:01:37,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 13:01:37,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:01:37,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:01:37,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e. 2023-09-24 13:01:37,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de. 2023-09-24 13:01:37,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c315132baef93eef3c835c428416a6de: 2023-09-24 13:01:37,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 05be4f3d8c3d47397a87f5a5c979674e: 2023-09-24 13:01:37,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c315132baef93eef3c835c428416a6de 2023-09-24 13:01:37,665 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=c315132baef93eef3c835c428416a6de, regionState=CLOSED 2023-09-24 13:01:37,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 05be4f3d8c3d47397a87f5a5c979674e 2023-09-24 13:01:37,665 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695560497664"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560497664"}]},"ts":"1695560497664"} 2023-09-24 13:01:37,665 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=05be4f3d8c3d47397a87f5a5c979674e, regionState=CLOSED 2023-09-24 13:01:37,665 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695560497665"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560497665"}]},"ts":"1695560497665"} 2023-09-24 13:01:37,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-24 13:01:37,668 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure c315132baef93eef3c835c428416a6de, server=jenkins-hbase4.apache.org,44885,1695560427276 in 172 msec 2023-09-24 13:01:37,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-24 13:01:37,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 05be4f3d8c3d47397a87f5a5c979674e, server=jenkins-hbase4.apache.org,35765,1695560427316 in 174 msec 2023-09-24 13:01:37,669 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c315132baef93eef3c835c428416a6de, UNASSIGN in 180 msec 2023-09-24 13:01:37,671 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-24 13:01:37,671 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=05be4f3d8c3d47397a87f5a5c979674e, UNASSIGN in 181 msec 2023-09-24 13:01:37,671 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560497671"}]},"ts":"1695560497671"} 2023-09-24 13:01:37,672 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-24 13:01:37,674 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-24 13:01:37,676 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 196 msec 2023-09-24 13:01:37,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-24 13:01:37,786 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-24 13:01:37,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-24 13:01:37,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 13:01:37,790 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 13:01:37,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-24 13:01:37,791 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 13:01:37,794 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35765] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-24 13:01:37,796 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 13:01:37,796 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 13:01:37,796 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 13:01:37,796 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 13:01:37,797 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-24 13:01:37,797 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-24 13:01:37,797 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-24 13:01:37,797 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-24 13:01:37,797 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de 2023-09-24 13:01:37,797 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e 2023-09-24 13:01:37,798 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 13:01:37,798 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:37,798 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 13:01:37,798 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 13:01:37,798 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:37,798 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-24 13:01:37,798 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:37,798 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:37,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-24 13:01:37,800 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e/cf, FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e/recovered.edits] 2023-09-24 13:01:37,800 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de/cf, FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de/recovered.edits] 2023-09-24 13:01:37,804 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e/cf/0b9cf4867460415e96cf713b5118cfe2 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e/cf/0b9cf4867460415e96cf713b5118cfe2 2023-09-24 13:01:37,805 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de/cf/be88337636b249e5bb8d4317056b256c to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de/cf/be88337636b249e5bb8d4317056b256c 2023-09-24 13:01:37,808 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e/recovered.edits/9.seqid to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e/recovered.edits/9.seqid 2023-09-24 13:01:37,808 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de/recovered.edits/9.seqid to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de/recovered.edits/9.seqid 2023-09-24 13:01:37,809 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/05be4f3d8c3d47397a87f5a5c979674e 2023-09-24 13:01:37,809 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testConsecutiveExports/c315132baef93eef3c835c428416a6de 2023-09-24 13:01:37,809 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-24 13:01:37,810 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-24 13:01:37,810 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-24 13:01:37,814 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309242f2308a7895345cf9a7f46e74406c47c to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202309242f2308a7895345cf9a7f46e74406c47c 2023-09-24 13:01:37,815 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023092444b30d02a3fe44f28b301f5cbd4c5a44 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023092444b30d02a3fe44f28b301f5cbd4c5a44 2023-09-24 13:01:37,816 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-24 13:01:37,818 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 13:01:37,821 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-24 13:01:37,823 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-24 13:01:37,824 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 13:01:37,824 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-24 13:01:37,824 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695560497824"}]},"ts":"9223372036854775807"} 2023-09-24 13:01:37,824 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695560497824"}]},"ts":"9223372036854775807"} 2023-09-24 13:01:37,826 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 13:01:37,826 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c315132baef93eef3c835c428416a6de, NAME => 'testtb-testConsecutiveExports,,1695560468044.c315132baef93eef3c835c428416a6de.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 05be4f3d8c3d47397a87f5a5c979674e, NAME => 'testtb-testConsecutiveExports,1,1695560468044.05be4f3d8c3d47397a87f5a5c979674e.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 13:01:37,826 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-24 13:01:37,826 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695560497826"}]},"ts":"9223372036854775807"} 2023-09-24 13:01:37,828 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-24 13:01:37,830 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-24 13:01:37,832 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 43 msec 2023-09-24 13:01:37,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-24 13:01:37,901 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-24 13:01:37,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-24 13:01:37,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-24 13:01:37,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-24 13:01:37,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-24 13:01:37,936 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=749 (was 762), OpenFileDescriptor=905 (was 940), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=101 (was 134), ProcessCount=168 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=7366 (was 7529) 2023-09-24 13:01:37,936 WARN [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-24 13:01:37,955 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=101, ProcessCount=168, AvailableMemoryMB=7365 2023-09-24 13:01:37,955 WARN [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-24 13:01:37,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 13:01:37,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:37,960 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 13:01:37,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-24 13:01:37,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-24 13:01:37,961 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 13:01:37,964 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b 2023-09-24 13:01:37,964 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7 2023-09-24 13:01:37,964 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b empty. 2023-09-24 13:01:37,964 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7 empty. 2023-09-24 13:01:37,965 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b 2023-09-24 13:01:37,965 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7 2023-09-24 13:01:37,965 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-24 13:01:37,975 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-24 13:01:37,976 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => b6723dbdc55f57a0aa1c1280b733c97b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp 2023-09-24 13:01:37,976 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 674542588f805a51bf30fe8dd69eefb7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp 2023-09-24 13:01:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 674542588f805a51bf30fe8dd69eefb7, disabling compactions & flushes 2023-09-24 13:01:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:37,984 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. 2023-09-24 13:01:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing b6723dbdc55f57a0aa1c1280b733c97b, disabling compactions & flushes 2023-09-24 13:01:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. 2023-09-24 13:01:37,984 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. after waiting 0 ms 2023-09-24 13:01:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. 2023-09-24 13:01:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. after waiting 0 ms 2023-09-24 13:01:37,984 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. 2023-09-24 13:01:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 674542588f805a51bf30fe8dd69eefb7: 2023-09-24 13:01:37,984 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:37,984 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for b6723dbdc55f57a0aa1c1280b733c97b: 2023-09-24 13:01:37,987 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 13:01:37,988 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695560497987"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560497987"}]},"ts":"1695560497987"} 2023-09-24 13:01:37,988 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695560497987"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560497987"}]},"ts":"1695560497987"} 2023-09-24 13:01:37,994 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 13:01:37,994 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 13:01:37,995 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560497995"}]},"ts":"1695560497995"} 2023-09-24 13:01:37,996 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-24 13:01:38,000 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 13:01:38,001 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 13:01:38,001 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 13:01:38,001 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 13:01:38,001 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 13:01:38,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b6723dbdc55f57a0aa1c1280b733c97b, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=674542588f805a51bf30fe8dd69eefb7, ASSIGN}] 2023-09-24 13:01:38,004 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=674542588f805a51bf30fe8dd69eefb7, ASSIGN 2023-09-24 13:01:38,004 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b6723dbdc55f57a0aa1c1280b733c97b, ASSIGN 2023-09-24 13:01:38,004 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=674542588f805a51bf30fe8dd69eefb7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40801,1695560427220; forceNewPlan=false, retain=false 2023-09-24 13:01:38,004 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b6723dbdc55f57a0aa1c1280b733c97b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44885,1695560427276; forceNewPlan=false, retain=false 2023-09-24 13:01:38,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-24 13:01:38,155 INFO [jenkins-hbase4:39481] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 13:01:38,157 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=674542588f805a51bf30fe8dd69eefb7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,157 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=b6723dbdc55f57a0aa1c1280b733c97b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,157 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695560498157"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560498157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560498157"}]},"ts":"1695560498157"} 2023-09-24 13:01:38,158 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695560498157"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560498157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560498157"}]},"ts":"1695560498157"} 2023-09-24 13:01:38,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 674542588f805a51bf30fe8dd69eefb7, server=jenkins-hbase4.apache.org,40801,1695560427220}] 2023-09-24 13:01:38,160 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure b6723dbdc55f57a0aa1c1280b733c97b, server=jenkins-hbase4.apache.org,44885,1695560427276}] 2023-09-24 13:01:38,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-24 13:01:38,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:38,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. 2023-09-24 13:01:38,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b6723dbdc55f57a0aa1c1280b733c97b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 13:01:38,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 674542588f805a51bf30fe8dd69eefb7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 13:01:38,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. service=AccessControlService 2023-09-24 13:01:38,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. service=AccessControlService 2023-09-24 13:01:38,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:01:38,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:01:38,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion b6723dbdc55f57a0aa1c1280b733c97b 2023-09-24 13:01:38,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 674542588f805a51bf30fe8dd69eefb7 2023-09-24 13:01:38,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:38,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:38,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b6723dbdc55f57a0aa1c1280b733c97b 2023-09-24 13:01:38,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 674542588f805a51bf30fe8dd69eefb7 2023-09-24 13:01:38,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b6723dbdc55f57a0aa1c1280b733c97b 2023-09-24 13:01:38,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 674542588f805a51bf30fe8dd69eefb7 2023-09-24 13:01:38,318 INFO [StoreOpener-674542588f805a51bf30fe8dd69eefb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 674542588f805a51bf30fe8dd69eefb7 2023-09-24 13:01:38,318 INFO [StoreOpener-b6723dbdc55f57a0aa1c1280b733c97b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b6723dbdc55f57a0aa1c1280b733c97b 2023-09-24 13:01:38,320 DEBUG [StoreOpener-674542588f805a51bf30fe8dd69eefb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7/cf 2023-09-24 13:01:38,320 DEBUG [StoreOpener-674542588f805a51bf30fe8dd69eefb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7/cf 2023-09-24 13:01:38,320 DEBUG [StoreOpener-b6723dbdc55f57a0aa1c1280b733c97b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b/cf 2023-09-24 13:01:38,320 DEBUG [StoreOpener-b6723dbdc55f57a0aa1c1280b733c97b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b/cf 2023-09-24 13:01:38,321 INFO [StoreOpener-b6723dbdc55f57a0aa1c1280b733c97b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6723dbdc55f57a0aa1c1280b733c97b columnFamilyName cf 2023-09-24 13:01:38,321 INFO [StoreOpener-674542588f805a51bf30fe8dd69eefb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 674542588f805a51bf30fe8dd69eefb7 columnFamilyName cf 2023-09-24 13:01:38,325 INFO [StoreOpener-b6723dbdc55f57a0aa1c1280b733c97b-1] regionserver.HStore(310): Store=b6723dbdc55f57a0aa1c1280b733c97b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:01:38,325 INFO [StoreOpener-674542588f805a51bf30fe8dd69eefb7-1] regionserver.HStore(310): Store=674542588f805a51bf30fe8dd69eefb7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:01:38,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b 2023-09-24 13:01:38,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7 2023-09-24 13:01:38,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b 2023-09-24 13:01:38,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7 2023-09-24 13:01:38,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b6723dbdc55f57a0aa1c1280b733c97b 2023-09-24 13:01:38,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 674542588f805a51bf30fe8dd69eefb7 2023-09-24 13:01:38,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:01:38,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b6723dbdc55f57a0aa1c1280b733c97b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63657132, jitterRate=-0.05143481492996216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:01:38,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b6723dbdc55f57a0aa1c1280b733c97b: 2023-09-24 13:01:38,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:01:38,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 674542588f805a51bf30fe8dd69eefb7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71324010, jitterRate=0.06281057000160217}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:01:38,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 674542588f805a51bf30fe8dd69eefb7: 2023-09-24 13:01:38,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b., pid=61, masterSystemTime=1695560498312 2023-09-24 13:01:38,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7., pid=60, masterSystemTime=1695560498311 2023-09-24 13:01:38,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:38,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:38,337 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=b6723dbdc55f57a0aa1c1280b733c97b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. 2023-09-24 13:01:38,337 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695560498337"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560498337"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560498337"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560498337"}]},"ts":"1695560498337"} 2023-09-24 13:01:38,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. 2023-09-24 13:01:38,338 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=674542588f805a51bf30fe8dd69eefb7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,338 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695560498338"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560498338"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560498338"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560498338"}]},"ts":"1695560498338"} 2023-09-24 13:01:38,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-24 13:01:38,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure b6723dbdc55f57a0aa1c1280b733c97b, server=jenkins-hbase4.apache.org,44885,1695560427276 in 179 msec 2023-09-24 13:01:38,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-24 13:01:38,343 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 674542588f805a51bf30fe8dd69eefb7, server=jenkins-hbase4.apache.org,40801,1695560427220 in 181 msec 2023-09-24 13:01:38,344 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b6723dbdc55f57a0aa1c1280b733c97b, ASSIGN in 341 msec 2023-09-24 13:01:38,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-24 13:01:38,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=674542588f805a51bf30fe8dd69eefb7, ASSIGN in 342 msec 2023-09-24 13:01:38,346 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 13:01:38,346 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560498346"}]},"ts":"1695560498346"} 2023-09-24 13:01:38,347 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-24 13:01:38,350 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 13:01:38,350 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-24 13:01:38,352 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35765] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-24 13:01:38,354 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:38,354 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:38,354 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:38,354 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:38,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:38,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:38,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:38,356 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:38,357 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 398 msec 2023-09-24 13:01:38,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-24 13:01:38,565 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-24 13:01:38,568 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,568 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:38,569 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 13:01:38,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 13:01:38,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695560498582 (current time:1695560498582). 2023-09-24 13:01:38,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 13:01:38,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x1033059a to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:01:38,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a1d81b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:01:38,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:38,595 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:38,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1033059a to 127.0.0.1:55856 2023-09-24 13:01:38,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:01:38,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x5ddc4f76 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:01:38,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55cb8e82, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:01:38,605 DEBUG [hconnection-0x139dd5c2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:38,606 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:38,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:38,613 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:38,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ddc4f76 to 127.0.0.1:55856 2023-09-24 13:01:38,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:01:38,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-24 13:01:38,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 13:01:38,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 13:01:38,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 13:01:38,618 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 13:01:38,618 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695561098618 2023-09-24 13:01:38,618 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 13:01:38,620 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 13:01:38,620 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 13:01:38,621 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 13:01:38,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 13:01:38,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-24 13:01:38,623 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 13:01:38,623 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695561098623 2023-09-24 13:01:38,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,637 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-24 13:01:38,637 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:38,638 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-24 13:01:38,638 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-24 13:01:38,639 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,639 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,640 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:38,640 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:38,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:38,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:38,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:38,640 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,640 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:38,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:38,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:38,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:38,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,641 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,641 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-24 13:01:38,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-24 13:01:38,642 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,642 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 13:01:38,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-24 13:01:38,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,642 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 13:01:38,642 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 13:01:38,642 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 13:01:38,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,643 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 13:01:38,643 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 13:01:38,643 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:38,643 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:38,645 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,646 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 13:01:38,646 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 13:01:38,646 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 13:01:38,647 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 13:01:38,646 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 13:01:38,647 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 13:01:38,647 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 13:01:38,647 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:38,648 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 13:01:38,648 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 13:01:38,648 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 13:01:38,649 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,651 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,651 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:38,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:38,652 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,652 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,652 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:38,652 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,652 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:38,652 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:38,652 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,652 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:38,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:38,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:38,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:38,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-24 13:01:38,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2df8a4a8[Count = 1] remaining members to acquire global barrier 2023-09-24 13:01:38,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:38,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:38,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:38,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:38,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:38,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-24 13:01:38,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2df8a4a8[Count = 0] remaining members to acquire global barrier 2023-09-24 13:01:38,657 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-24 13:01:38,657 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,658 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,658 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,658 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,659 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,659 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 13:01:38,659 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 13:01:38,659 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 13:01:38,659 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 13:01:38,659 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35765,1695560427316' in zk 2023-09-24 13:01:38,659 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:01:38,659 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:01:38,659 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. 2023-09-24 13:01:38,659 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. started... 2023-09-24 13:01:38,659 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,659 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 13:01:38,662 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:01:38,662 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:01:38,662 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:38,662 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. started... 2023-09-24 13:01:38,662 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b6723dbdc55f57a0aa1c1280b733c97b: 2023-09-24 13:01:38,662 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,663 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:01:38,663 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 13:01:38,663 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 674542588f805a51bf30fe8dd69eefb7: 2023-09-24 13:01:38,663 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,663 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:01:38,663 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 13:01:38,666 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 13:01:38,666 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:38,666 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 13:01:38,681 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. completed. 2023-09-24 13:01:38,681 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:38,681 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:01:38,681 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:01:38,681 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,681 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 13:01:38,681 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44885,1695560427276' in zk 2023-09-24 13:01:38,683 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 13:01:38,683 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,683 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:38,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:38,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:38,683 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 13:01:38,685 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. completed. 2023-09-24 13:01:38,685 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. 2023-09-24 13:01:38,685 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:01:38,685 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:01:38,685 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:38,685 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 13:01:38,685 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40801,1695560427220' in zk 2023-09-24 13:01:38,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:38,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,687 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,687 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 13:01:38,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:38,687 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:38,687 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 13:01:38,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:38,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:38,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44885,1695560427276': 2023-09-24 13:01:38,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-24 13:01:38,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:38,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:38,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:38,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:38,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:38,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:38,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:38,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40801,1695560427220': 2023-09-24 13:01:38,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-24 13:01:38,695 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-24 13:01:38,695 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 13:01:38,695 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 13:01:38,695 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,695 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 13:01:38,697 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,697 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,697 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,697 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:38,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,697 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,697 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:38,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,698 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:38,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,698 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:38,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:38,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,701 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:38,702 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:38,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,704 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:38,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:38,705 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,705 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,709 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,709 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,710 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:38,710 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:38,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:38,710 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:38,710 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,710 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:38,710 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:38,710 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:38,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:38,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:38,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:38,710 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,712 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,712 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,712 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,712 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:38,712 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,712 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,710 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:38,712 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:38,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:38,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:38,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:38,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:38,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:38,712 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:38,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 13:01:38,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:38,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:38,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 13:01:38,720 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:01:38,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-24 13:01:38,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-24 13:01:38,721 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 13:01:38,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,748 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-24 13:01:38,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,748 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695560498618Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695560498727 (+109 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695560498727Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695560498727Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695560498732 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695560498742 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695560498748 (+6 ms) 2023-09-24 13:01:38,751 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 13:01:38,752 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 132 msec 2023-09-24 13:01:38,921 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:01:38,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-24 13:01:38,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 13:01:38,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44885] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 13:01:38,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40801] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 13:01:38,930 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,930 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:38,930 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 13:01:38,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 13:01:38,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695560498940 (current time:1695560498940). 2023-09-24 13:01:38,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 13:01:38,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x3373eacc to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:01:38,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50d81fe3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:01:38,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:38,951 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:38,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3373eacc to 127.0.0.1:55856 2023-09-24 13:01:38,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:01:38,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x68992401 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:01:38,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44908654, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:01:38,960 DEBUG [hconnection-0x54a7ae22-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:38,962 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:38,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:38,967 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:38,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68992401 to 127.0.0.1:55856 2023-09-24 13:01:38,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:01:38,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-24 13:01:38,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 13:01:38,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 13:01:38,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 13:01:38,972 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 13:01:38,972 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695561098972 2023-09-24 13:01:38,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-24 13:01:38,972 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,974 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 13:01:38,974 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 13:01:38,975 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-24 13:01:38,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 13:01:38,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-24 13:01:38,977 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 13:01:38,978 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695561098978 2023-09-24 13:01:38,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,987 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-24 13:01:38,987 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:38,988 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-24 13:01:38,988 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-24 13:01:38,989 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,989 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,990 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:38,990 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:38,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:38,990 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,990 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:38,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:38,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:38,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:38,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:38,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:38,991 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,991 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,991 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,991 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 13:01:38,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-24 13:01:38,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-24 13:01:38,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,992 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 13:01:38,992 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 13:01:38,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-24 13:01:38,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,992 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 13:01:38,992 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 13:01:38,992 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:38,992 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-24 13:01:38,993 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 13:01:38,993 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 13:01:38,993 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 13:01:38,992 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:38,995 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 13:01:38,995 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,995 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 13:01:38,995 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-24 13:01:38,995 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:38,995 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 13:01:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-24 13:01:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-24 13:01:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-24 13:01:38,997 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,997 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:38,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:38,998 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,998 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:38,998 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,998 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:38,998 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,998 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,998 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:38,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:38,998 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,998 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:38,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:38,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:38,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:38,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:38,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:39,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-24 13:01:39,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49c86b90[Count = 1] remaining members to acquire global barrier 2023-09-24 13:01:39,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:39,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:39,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:39,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:39,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:39,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:39,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-24 13:01:39,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49c86b90[Count = 0] remaining members to acquire global barrier 2023-09-24 13:01:39,002 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-24 13:01:39,002 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,004 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,004 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,004 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,004 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,004 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 13:01:39,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,004 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 13:01:39,004 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-24 13:01:39,004 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:01:39,005 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:01:39,005 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:01:39,005 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. 2023-09-24 13:01:39,004 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,005 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 13:01:39,004 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 13:01:39,005 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. started... 2023-09-24 13:01:39,005 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:39,005 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:01:39,005 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. started... 2023-09-24 13:01:39,005 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35765,1695560427316' in zk 2023-09-24 13:01:39,005 INFO [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 674542588f805a51bf30fe8dd69eefb7 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-24 13:01:39,005 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b6723dbdc55f57a0aa1c1280b733c97b 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-24 13:01:39,006 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 13:01:39,006 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:39,007 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 13:01:39,026 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230924bf365779910b4339a979e6fbde949ee0 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230924bf365779910b4339a979e6fbde949ee0 2023-09-24 13:01:39,027 INFO [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230924221b18d675e642b5a7f3235b54acae6a to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230924221b18d675e642b5a7f3235b54acae6a 2023-09-24 13:01:39,033 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b/.tmp/cf/374402cfe6d64e8ab8f25bd6ad6138ae 2023-09-24 13:01:39,035 INFO [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7/.tmp/cf/cc3f9257094548488002754af685f571 2023-09-24 13:01:39,038 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b/.tmp/cf/374402cfe6d64e8ab8f25bd6ad6138ae as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b/cf/374402cfe6d64e8ab8f25bd6ad6138ae 2023-09-24 13:01:39,039 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7/.tmp/cf/cc3f9257094548488002754af685f571 as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7/cf/cc3f9257094548488002754af685f571 2023-09-24 13:01:39,043 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b/cf/374402cfe6d64e8ab8f25bd6ad6138ae, entries=3, sequenceid=6, filesize=5.4 K 2023-09-24 13:01:39,044 INFO [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7/cf/cc3f9257094548488002754af685f571, entries=47, sequenceid=6, filesize=13.5 K 2023-09-24 13:01:39,045 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for b6723dbdc55f57a0aa1c1280b733c97b in 40ms, sequenceid=6, compaction requested=false 2023-09-24 13:01:39,045 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-24 13:01:39,045 INFO [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 674542588f805a51bf30fe8dd69eefb7 in 40ms, sequenceid=6, compaction requested=false 2023-09-24 13:01:39,045 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-24 13:01:39,047 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b6723dbdc55f57a0aa1c1280b733c97b: 2023-09-24 13:01:39,047 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 674542588f805a51bf30fe8dd69eefb7: 2023-09-24 13:01:39,047 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,047 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:01:39,047 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,047 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b/cf/374402cfe6d64e8ab8f25bd6ad6138ae] hfiles 2023-09-24 13:01:39,047 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b/cf/374402cfe6d64e8ab8f25bd6ad6138ae for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,047 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:01:39,047 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7/cf/cc3f9257094548488002754af685f571] hfiles 2023-09-24 13:01:39,047 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7/cf/cc3f9257094548488002754af685f571 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,056 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. completed. 2023-09-24 13:01:39,056 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. 2023-09-24 13:01:39,056 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. completed. 2023-09-24 13:01:39,056 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:01:39,056 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:01:39,056 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,056 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:39,056 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 13:01:39,056 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:01:39,056 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:01:39,056 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,056 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40801,1695560427220' in zk 2023-09-24 13:01:39,056 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-24 13:01:39,056 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,44885,1695560427276' in zk 2023-09-24 13:01:39,058 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,058 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 13:01:39,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,058 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:39,058 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,058 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-24 13:01:39,058 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 13:01:39,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:39,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:39,059 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:39,059 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-24 13:01:39,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40801,1695560427220': 2023-09-24 13:01:39,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-24 13:01:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:39,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:39,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:39,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:39,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:39,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,44885,1695560427276': 2023-09-24 13:01:39,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-24 13:01:39,067 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-24 13:01:39,067 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 13:01:39,067 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 13:01:39,067 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,067 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 13:01:39,073 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,073 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,073 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:39,073 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,073 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,073 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,073 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:39,073 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:39,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:39,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:39,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:39,074 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:39,074 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:01:39,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:39,074 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:39,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:39,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-24 13:01:39,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-24 13:01:39,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:39,075 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 13:01:39,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,076 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:39,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:39,077 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,077 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,080 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,080 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,080 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:39,080 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:39,080 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:39,080 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:39,080 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:39,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:39,080 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:39,080 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:39,080 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:39,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:39,080 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,080 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:39,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:39,082 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,082 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,081 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:39,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:39,082 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 13:01:39,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:39,082 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:39,082 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:39,082 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,082 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230924221b18d675e642b5a7f3235b54acae6a, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230924bf365779910b4339a979e6fbde949ee0] mob files 2023-09-24 13:01:39,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230924221b18d675e642b5a7f3235b54acae6a 2023-09-24 13:01:39,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230924bf365779910b4339a979e6fbde949ee0 2023-09-24 13:01:39,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,109 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-24 13:01:39,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,109 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:39,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695560498973Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695560499091 (+118 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695560499091Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695560499091Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695560499095 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695560499102 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695560499109 (+7 ms) 2023-09-24 13:01:39,112 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-24 13:01:39,113 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 139 msec 2023-09-24 13:01:39,276 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:01:39,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-24 13:01:39,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 13:01:39,306 DEBUG [Listener at jenkins-hbase4.apache.org/34119] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 13:01:39,310 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 13:01:39,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35765] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-24 13:01:39,312 DEBUG [Listener at jenkins-hbase4.apache.org/34119] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 13:01:39,315 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 13:01:39,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40801] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-24 13:01:39,316 DEBUG [Listener at jenkins-hbase4.apache.org/34119] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-24 13:01:39,319 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-24 13:01:39,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44885] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-24 13:01:39,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-24 13:01:39,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:39,324 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 13:01:39,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-24 13:01:39,325 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 13:01:39,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-24 13:01:39,327 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2 2023-09-24 13:01:39,327 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d 2023-09-24 13:01:39,328 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2 empty. 2023-09-24 13:01:39,328 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d empty. 2023-09-24 13:01:39,328 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2 2023-09-24 13:01:39,328 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d 2023-09-24 13:01:39,328 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-24 13:01:39,337 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-24 13:01:39,338 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => f0edd62a504bfd813817c41c56611de2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp 2023-09-24 13:01:39,338 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 52b4057bf796e89ab25e6566a46c454d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp 2023-09-24 13:01:39,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:39,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:39,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing f0edd62a504bfd813817c41c56611de2, disabling compactions & flushes 2023-09-24 13:01:39,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 52b4057bf796e89ab25e6566a46c454d, disabling compactions & flushes 2023-09-24 13:01:39,347 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2. 2023-09-24 13:01:39,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2. 2023-09-24 13:01:39,347 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d. 2023-09-24 13:01:39,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d. 2023-09-24 13:01:39,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2. after waiting 0 ms 2023-09-24 13:01:39,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d. after waiting 0 ms 2023-09-24 13:01:39,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d. 2023-09-24 13:01:39,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2. 2023-09-24 13:01:39,347 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d. 2023-09-24 13:01:39,348 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2. 2023-09-24 13:01:39,348 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 52b4057bf796e89ab25e6566a46c454d: 2023-09-24 13:01:39,348 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for f0edd62a504bfd813817c41c56611de2: 2023-09-24 13:01:39,350 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 13:01:39,351 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695560499351"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560499351"}]},"ts":"1695560499351"} 2023-09-24 13:01:39,351 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695560499351"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560499351"}]},"ts":"1695560499351"} 2023-09-24 13:01:39,353 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 13:01:39,354 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 13:01:39,354 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560499354"}]},"ts":"1695560499354"} 2023-09-24 13:01:39,355 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-24 13:01:39,358 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 13:01:39,359 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 13:01:39,359 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 13:01:39,359 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 13:01:39,359 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 13:01:39,360 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f0edd62a504bfd813817c41c56611de2, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=52b4057bf796e89ab25e6566a46c454d, ASSIGN}] 2023-09-24 13:01:39,362 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=52b4057bf796e89ab25e6566a46c454d, ASSIGN 2023-09-24 13:01:39,362 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f0edd62a504bfd813817c41c56611de2, ASSIGN 2023-09-24 13:01:39,363 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=52b4057bf796e89ab25e6566a46c454d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40801,1695560427220; forceNewPlan=false, retain=false 2023-09-24 13:01:39,364 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f0edd62a504bfd813817c41c56611de2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44885,1695560427276; forceNewPlan=false, retain=false 2023-09-24 13:01:39,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-24 13:01:39,513 INFO [jenkins-hbase4:39481] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 13:01:39,516 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f0edd62a504bfd813817c41c56611de2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,516 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=52b4057bf796e89ab25e6566a46c454d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,516 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695560499516"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560499516"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560499516"}]},"ts":"1695560499516"} 2023-09-24 13:01:39,516 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695560499516"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560499516"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560499516"}]},"ts":"1695560499516"} 2023-09-24 13:01:39,518 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure f0edd62a504bfd813817c41c56611de2, server=jenkins-hbase4.apache.org,44885,1695560427276}] 2023-09-24 13:01:39,519 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 52b4057bf796e89ab25e6566a46c454d, server=jenkins-hbase4.apache.org,40801,1695560427220}] 2023-09-24 13:01:39,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-24 13:01:39,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2. 2023-09-24 13:01:39,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d. 2023-09-24 13:01:39,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f0edd62a504bfd813817c41c56611de2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2.', STARTKEY => '', ENDKEY => '2'} 2023-09-24 13:01:39,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 52b4057bf796e89ab25e6566a46c454d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d.', STARTKEY => '2', ENDKEY => ''} 2023-09-24 13:01:39,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d. service=AccessControlService 2023-09-24 13:01:39,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2. service=AccessControlService 2023-09-24 13:01:39,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:01:39,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:01:39,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 52b4057bf796e89ab25e6566a46c454d 2023-09-24 13:01:39,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f0edd62a504bfd813817c41c56611de2 2023-09-24 13:01:39,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:39,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:39,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 52b4057bf796e89ab25e6566a46c454d 2023-09-24 13:01:39,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f0edd62a504bfd813817c41c56611de2 2023-09-24 13:01:39,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 52b4057bf796e89ab25e6566a46c454d 2023-09-24 13:01:39,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f0edd62a504bfd813817c41c56611de2 2023-09-24 13:01:39,676 INFO [StoreOpener-52b4057bf796e89ab25e6566a46c454d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 52b4057bf796e89ab25e6566a46c454d 2023-09-24 13:01:39,676 INFO [StoreOpener-f0edd62a504bfd813817c41c56611de2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f0edd62a504bfd813817c41c56611de2 2023-09-24 13:01:39,677 DEBUG [StoreOpener-52b4057bf796e89ab25e6566a46c454d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d/cf 2023-09-24 13:01:39,677 DEBUG [StoreOpener-52b4057bf796e89ab25e6566a46c454d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d/cf 2023-09-24 13:01:39,677 DEBUG [StoreOpener-f0edd62a504bfd813817c41c56611de2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2/cf 2023-09-24 13:01:39,677 DEBUG [StoreOpener-f0edd62a504bfd813817c41c56611de2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2/cf 2023-09-24 13:01:39,677 INFO [StoreOpener-52b4057bf796e89ab25e6566a46c454d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52b4057bf796e89ab25e6566a46c454d columnFamilyName cf 2023-09-24 13:01:39,677 INFO [StoreOpener-f0edd62a504bfd813817c41c56611de2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f0edd62a504bfd813817c41c56611de2 columnFamilyName cf 2023-09-24 13:01:39,678 INFO [StoreOpener-52b4057bf796e89ab25e6566a46c454d-1] regionserver.HStore(310): Store=52b4057bf796e89ab25e6566a46c454d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:01:39,678 INFO [StoreOpener-f0edd62a504bfd813817c41c56611de2-1] regionserver.HStore(310): Store=f0edd62a504bfd813817c41c56611de2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:01:39,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2 2023-09-24 13:01:39,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d 2023-09-24 13:01:39,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2 2023-09-24 13:01:39,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d 2023-09-24 13:01:39,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 52b4057bf796e89ab25e6566a46c454d 2023-09-24 13:01:39,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f0edd62a504bfd813817c41c56611de2 2023-09-24 13:01:39,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:01:39,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:01:39,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 52b4057bf796e89ab25e6566a46c454d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74137454, jitterRate=0.1047341525554657}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:01:39,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f0edd62a504bfd813817c41c56611de2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70646006, jitterRate=0.052707523107528687}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:01:39,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 52b4057bf796e89ab25e6566a46c454d: 2023-09-24 13:01:39,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f0edd62a504bfd813817c41c56611de2: 2023-09-24 13:01:39,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d., pid=70, masterSystemTime=1695560499670 2023-09-24 13:01:39,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2., pid=69, masterSystemTime=1695560499670 2023-09-24 13:01:39,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d. 2023-09-24 13:01:39,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d. 2023-09-24 13:01:39,688 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=52b4057bf796e89ab25e6566a46c454d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2. 2023-09-24 13:01:39,688 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695560499688"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560499688"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560499688"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560499688"}]},"ts":"1695560499688"} 2023-09-24 13:01:39,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2. 2023-09-24 13:01:39,689 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=f0edd62a504bfd813817c41c56611de2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,689 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695560499688"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560499688"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560499688"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560499688"}]},"ts":"1695560499688"} 2023-09-24 13:01:39,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-24 13:01:39,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 52b4057bf796e89ab25e6566a46c454d, server=jenkins-hbase4.apache.org,40801,1695560427220 in 170 msec 2023-09-24 13:01:39,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-24 13:01:39,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure f0edd62a504bfd813817c41c56611de2, server=jenkins-hbase4.apache.org,44885,1695560427276 in 172 msec 2023-09-24 13:01:39,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=52b4057bf796e89ab25e6566a46c454d, ASSIGN in 331 msec 2023-09-24 13:01:39,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-24 13:01:39,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f0edd62a504bfd813817c41c56611de2, ASSIGN in 332 msec 2023-09-24 13:01:39,694 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 13:01:39,694 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560499694"}]},"ts":"1695560499694"} 2023-09-24 13:01:39,695 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-24 13:01:39,699 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 13:01:39,699 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-24 13:01:39,701 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35765] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-24 13:01:39,702 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:39,702 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:39,702 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:39,702 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:39,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:39,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:39,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:39,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:39,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:39,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:39,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:39,704 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:39,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 382 msec 2023-09-24 13:01:39,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-24 13:01:39,929 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-24 13:01:39,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions f0edd62a504bfd813817c41c56611de2, 52b4057bf796e89ab25e6566a46c454d 2023-09-24 13:01:39,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f0edd62a504bfd813817c41c56611de2, 52b4057bf796e89ab25e6566a46c454d], force=true 2023-09-24 13:01:39,961 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f0edd62a504bfd813817c41c56611de2, 52b4057bf796e89ab25e6566a46c454d], force=true 2023-09-24 13:01:39,961 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f0edd62a504bfd813817c41c56611de2, 52b4057bf796e89ab25e6566a46c454d], force=true 2023-09-24 13:01:39,961 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f0edd62a504bfd813817c41c56611de2, 52b4057bf796e89ab25e6566a46c454d], force=true 2023-09-24 13:01:39,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-24 13:01:39,983 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f0edd62a504bfd813817c41c56611de2, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=52b4057bf796e89ab25e6566a46c454d, UNASSIGN}] 2023-09-24 13:01:39,985 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f0edd62a504bfd813817c41c56611de2, UNASSIGN 2023-09-24 13:01:39,985 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=52b4057bf796e89ab25e6566a46c454d, UNASSIGN 2023-09-24 13:01:39,986 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f0edd62a504bfd813817c41c56611de2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:39,986 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=52b4057bf796e89ab25e6566a46c454d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:39,986 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695560499985"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560499985"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560499985"}]},"ts":"1695560499985"} 2023-09-24 13:01:39,986 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695560499986"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560499986"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560499986"}]},"ts":"1695560499986"} 2023-09-24 13:01:39,987 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure f0edd62a504bfd813817c41c56611de2, server=jenkins-hbase4.apache.org,44885,1695560427276}] 2023-09-24 13:01:39,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 52b4057bf796e89ab25e6566a46c454d, server=jenkins-hbase4.apache.org,40801,1695560427220}] 2023-09-24 13:01:40,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-24 13:01:40,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f0edd62a504bfd813817c41c56611de2 2023-09-24 13:01:40,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f0edd62a504bfd813817c41c56611de2, disabling compactions & flushes 2023-09-24 13:01:40,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 52b4057bf796e89ab25e6566a46c454d 2023-09-24 13:01:40,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2. 2023-09-24 13:01:40,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2. 2023-09-24 13:01:40,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 52b4057bf796e89ab25e6566a46c454d, disabling compactions & flushes 2023-09-24 13:01:40,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2. after waiting 0 ms 2023-09-24 13:01:40,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2. 2023-09-24 13:01:40,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d. 2023-09-24 13:01:40,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d. 2023-09-24 13:01:40,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d. after waiting 0 ms 2023-09-24 13:01:40,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d. 2023-09-24 13:01:40,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f0edd62a504bfd813817c41c56611de2 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-24 13:01:40,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 52b4057bf796e89ab25e6566a46c454d 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-24 13:01:40,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d/.tmp/cf/9f8777782a1a4178969b9f4de548ff71 2023-09-24 13:01:40,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2/.tmp/cf/9020b594996c4ff7b1c6b3939c1d3563 2023-09-24 13:01:40,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d/.tmp/cf/9f8777782a1a4178969b9f4de548ff71 as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d/cf/9f8777782a1a4178969b9f4de548ff71 2023-09-24 13:01:40,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2/.tmp/cf/9020b594996c4ff7b1c6b3939c1d3563 as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2/cf/9020b594996c4ff7b1c6b3939c1d3563 2023-09-24 13:01:40,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d/cf/9f8777782a1a4178969b9f4de548ff71, entries=1, sequenceid=5, filesize=4.7 K 2023-09-24 13:01:40,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2/cf/9020b594996c4ff7b1c6b3939c1d3563, entries=1, sequenceid=5, filesize=4.7 K 2023-09-24 13:01:40,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 52b4057bf796e89ab25e6566a46c454d in 22ms, sequenceid=5, compaction requested=false 2023-09-24 13:01:40,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-24 13:01:40,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for f0edd62a504bfd813817c41c56611de2 in 22ms, sequenceid=5, compaction requested=false 2023-09-24 13:01:40,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-24 13:01:40,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-24 13:01:40,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-24 13:01:40,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:01:40,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2. 2023-09-24 13:01:40,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f0edd62a504bfd813817c41c56611de2: 2023-09-24 13:01:40,180 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f0edd62a504bfd813817c41c56611de2 2023-09-24 13:01:40,180 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=f0edd62a504bfd813817c41c56611de2, regionState=CLOSED 2023-09-24 13:01:40,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:01:40,181 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695560500180"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560500180"}]},"ts":"1695560500180"} 2023-09-24 13:01:40,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d. 2023-09-24 13:01:40,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 52b4057bf796e89ab25e6566a46c454d: 2023-09-24 13:01:40,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 52b4057bf796e89ab25e6566a46c454d 2023-09-24 13:01:40,183 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=52b4057bf796e89ab25e6566a46c454d, regionState=CLOSED 2023-09-24 13:01:40,183 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695560500182"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560500182"}]},"ts":"1695560500182"} 2023-09-24 13:01:40,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-24 13:01:40,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure f0edd62a504bfd813817c41c56611de2, server=jenkins-hbase4.apache.org,44885,1695560427276 in 195 msec 2023-09-24 13:01:40,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f0edd62a504bfd813817c41c56611de2, UNASSIGN in 205 msec 2023-09-24 13:01:40,186 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-24 13:01:40,186 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 52b4057bf796e89ab25e6566a46c454d, server=jenkins-hbase4.apache.org,40801,1695560427220 in 196 msec 2023-09-24 13:01:40,188 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-24 13:01:40,188 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=52b4057bf796e89ab25e6566a46c454d, UNASSIGN in 203 msec 2023-09-24 13:01:40,231 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-24 13:01:40,233 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499321.f0edd62a504bfd813817c41c56611de2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-24 13:01:40,233 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695560499321.52b4057bf796e89ab25e6566a46c454d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-24 13:01:40,233 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-24 13:01:40,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-24 13:01:40,284 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c875522733bc59e9c91dca5abdea4d91, ASSIGN}] 2023-09-24 13:01:40,285 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c875522733bc59e9c91dca5abdea4d91, ASSIGN 2023-09-24 13:01:40,285 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c875522733bc59e9c91dca5abdea4d91, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,44885,1695560427276; forceNewPlan=false, retain=false 2023-09-24 13:01:40,435 INFO [jenkins-hbase4:39481] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-24 13:01:40,437 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c875522733bc59e9c91dca5abdea4d91, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:40,437 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695560500437"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560500437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560500437"}]},"ts":"1695560500437"} 2023-09-24 13:01:40,439 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure c875522733bc59e9c91dca5abdea4d91, server=jenkins-hbase4.apache.org,44885,1695560427276}] 2023-09-24 13:01:40,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-24 13:01:40,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91. 2023-09-24 13:01:40,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c875522733bc59e9c91dca5abdea4d91, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91.', STARTKEY => '', ENDKEY => ''} 2023-09-24 13:01:40,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91. service=AccessControlService 2023-09-24 13:01:40,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:01:40,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c875522733bc59e9c91dca5abdea4d91 2023-09-24 13:01:40,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:40,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c875522733bc59e9c91dca5abdea4d91 2023-09-24 13:01:40,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c875522733bc59e9c91dca5abdea4d91 2023-09-24 13:01:40,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/.regioninfo 2023-09-24 13:01:40,603 INFO [StoreOpener-c875522733bc59e9c91dca5abdea4d91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c875522733bc59e9c91dca5abdea4d91 2023-09-24 13:01:40,604 DEBUG [StoreOpener-c875522733bc59e9c91dca5abdea4d91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/cf 2023-09-24 13:01:40,604 DEBUG [StoreOpener-c875522733bc59e9c91dca5abdea4d91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/cf 2023-09-24 13:01:40,605 INFO [StoreOpener-c875522733bc59e9c91dca5abdea4d91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c875522733bc59e9c91dca5abdea4d91 columnFamilyName cf 2023-09-24 13:01:40,631 DEBUG [StoreOpener-c875522733bc59e9c91dca5abdea4d91-1] regionserver.HStore(539): loaded hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/cf/9020b594996c4ff7b1c6b3939c1d3563.f0edd62a504bfd813817c41c56611de2->hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2/cf/9020b594996c4ff7b1c6b3939c1d3563-top 2023-09-24 13:01:40,637 DEBUG [StoreOpener-c875522733bc59e9c91dca5abdea4d91-1] regionserver.HStore(539): loaded hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/cf/9f8777782a1a4178969b9f4de548ff71.52b4057bf796e89ab25e6566a46c454d->hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d/cf/9f8777782a1a4178969b9f4de548ff71-top 2023-09-24 13:01:40,637 INFO [StoreOpener-c875522733bc59e9c91dca5abdea4d91-1] regionserver.HStore(310): Store=c875522733bc59e9c91dca5abdea4d91/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:01:40,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91 2023-09-24 13:01:40,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91 2023-09-24 13:01:40,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c875522733bc59e9c91dca5abdea4d91 2023-09-24 13:01:40,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c875522733bc59e9c91dca5abdea4d91; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68803278, jitterRate=0.025248736143112183}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:01:40,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c875522733bc59e9c91dca5abdea4d91: 2023-09-24 13:01:40,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91., pid=77, masterSystemTime=1695560500590 2023-09-24 13:01:40,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91.,because compaction is disabled. 2023-09-24 13:01:40,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91. 2023-09-24 13:01:40,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91. 2023-09-24 13:01:40,645 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c875522733bc59e9c91dca5abdea4d91, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:40,646 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695560500645"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560500645"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560500645"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560500645"}]},"ts":"1695560500645"} 2023-09-24 13:01:40,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-24 13:01:40,649 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure c875522733bc59e9c91dca5abdea4d91, server=jenkins-hbase4.apache.org,44885,1695560427276 in 208 msec 2023-09-24 13:01:40,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-24 13:01:40,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c875522733bc59e9c91dca5abdea4d91, ASSIGN in 366 msec 2023-09-24 13:01:40,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[f0edd62a504bfd813817c41c56611de2, 52b4057bf796e89ab25e6566a46c454d], force=true in 696 msec 2023-09-24 13:01:41,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-24 13:01:41,068 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-24 13:01:41,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-24 13:01:41,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695560501069 (current time:1695560501069). 2023-09-24 13:01:41,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 13:01:41,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x0c309229 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:01:41,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c469b76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:01:41,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:41,080 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:41,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c309229 to 127.0.0.1:55856 2023-09-24 13:01:41,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:01:41,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x17c883d5 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:01:41,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fe1fadf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:01:41,088 DEBUG [hconnection-0x77145f7e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:41,090 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:41,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:41,097 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:41,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17c883d5 to 127.0.0.1:55856 2023-09-24 13:01:41,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:01:41,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-24 13:01:41,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 13:01:41,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-24 13:01:41,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-24 13:01:41,101 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-24 13:01:41,102 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695561101102 2023-09-24 13:01:41,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-24 13:01:41,102 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,105 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 13:01:41,106 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 13:01:41,107 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-24 13:01:41,107 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-24 13:01:41,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-24 13:01:41,109 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-24 13:01:41,109 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695561101109 2023-09-24 13:01:41,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,117 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-24 13:01:41,118 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:41,119 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-24 13:01:41,119 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-24 13:01:41,119 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,119 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,120 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:41,120 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:41,120 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:41,120 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:41,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:41,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:41,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:41,121 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,121 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 13:01:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-24 13:01:41,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-24 13:01:41,122 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-24 13:01:41,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-24 13:01:41,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,122 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-24 13:01:41,122 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-24 13:01:41,122 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:41,122 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-24 13:01:41,123 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-24 13:01:41,123 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,123 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-24 13:01:41,123 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-24 13:01:41,123 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-24 13:01:41,123 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,123 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:41,124 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-24 13:01:41,124 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-24 13:01:41,124 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-24 13:01:41,124 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:41,125 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-24 13:01:41,125 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-24 13:01:41,125 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-24 13:01:41,125 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-24 13:01:41,128 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,129 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,129 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:41,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:41,129 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,129 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,129 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:41,129 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:41,129 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:41,130 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,130 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:41,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:41,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:41,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-24 13:01:41,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2eeff6c[Count = 0] remaining members to acquire global barrier 2023-09-24 13:01:41,132 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-24 13:01:41,132 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,133 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,133 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,133 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,133 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,133 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-24 13:01:41,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,133 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 13:01:41,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,133 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:01:41,133 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-24 13:01:41,133 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91. 2023-09-24 13:01:41,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,133 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91. started... 2023-09-24 13:01:41,133 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-24 13:01:41,133 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-24 13:01:41,134 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40801,1695560427220' in zk 2023-09-24 13:01:41,133 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:01:41,133 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-24 13:01:41,134 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c875522733bc59e9c91dca5abdea4d91: 2023-09-24 13:01:41,135 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35765,1695560427316' in zk 2023-09-24 13:01:41,135 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,135 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:01:41,135 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/cf/9020b594996c4ff7b1c6b3939c1d3563.f0edd62a504bfd813817c41c56611de2->hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2/cf/9020b594996c4ff7b1c6b3939c1d3563-top, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/cf/9f8777782a1a4178969b9f4de548ff71.52b4057bf796e89ab25e6566a46c454d->hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d/cf/9f8777782a1a4178969b9f4de548ff71-top] hfiles 2023-09-24 13:01:41,135 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/cf/9020b594996c4ff7b1c6b3939c1d3563.f0edd62a504bfd813817c41c56611de2 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,136 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/cf/9f8777782a1a4178969b9f4de548ff71.52b4057bf796e89ab25e6566a46c454d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,137 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-24 13:01:41,137 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:41,137 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-24 13:01:41,138 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-24 13:01:41,138 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:41,138 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-24 13:01:41,146 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91. completed. 2023-09-24 13:01:41,146 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91. 2023-09-24 13:01:41,146 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:01:41,146 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:01:41,146 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,146 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-24 13:01:41,146 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,44885,1695560427276' in zk 2023-09-24 13:01:41,154 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-24 13:01:41,154 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,154 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,154 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-24 13:01:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:41,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:41,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:41,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:41,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:41,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:41,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,44885,1695560427276': 2023-09-24 13:01:41,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-24 13:01:41,157 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-24 13:01:41,157 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 13:01:41,158 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 13:01:41,158 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,158 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 13:01:41,160 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,160 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,160 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,160 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:41,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,160 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,160 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:41,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:41,160 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:41,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:41,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:41,160 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:41,161 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:41,161 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:41,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:41,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:41,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:41,163 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:41,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,164 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:41,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:41,164 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:41,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:41,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,201 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:41,201 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:41,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:41,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:41,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:41,202 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,201 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:41,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,201 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:41,201 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:41,201 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:41,202 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:41,202 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:41,202 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:41,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:41,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:41,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:41,202 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:41,203 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:41,203 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,203 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:41,203 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,203 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:41,203 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:41,203 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,203 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:41,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:41,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:41,206 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:01:41,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-24 13:01:41,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-09-24 13:01:41,207 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 13:01:41,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,222 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-24 13:01:41,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,222 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695560501102Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695560501202 (+100 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695560501202Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695560501206 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695560501215 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695560501222 (+7 ms) 2023-09-24 13:01:41,225 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-24 13:01:41,226 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 120 msec 2023-09-24 13:01:41,407 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:01:41,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-24 13:01:41,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 13:01:41,408 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560501408 2023-09-24 13:01:41,409 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36659, tgtDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560501408, rawTgtDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560501408, srcFsUri=hdfs://localhost:36659, srcDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:01:41,430 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36659, inputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:01:41,430 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_163369162_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560501408, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560501408/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,430 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36659, inputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68, snapshotDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-24 13:01:41,438 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560501408/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:41,453 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:41,453 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:41,454 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:41,454 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:42,326 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop-8550256217923959554.jar 2023-09-24 13:01:42,327 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:42,327 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:42,394 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop-4485721750833686155.jar 2023-09-24 13:01:42,394 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:42,395 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:42,395 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:42,396 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:42,396 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:42,396 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:42,397 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 13:01:42,397 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 13:01:42,397 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 13:01:42,398 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 13:01:42,398 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 13:01:42,399 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 13:01:42,399 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 13:01:42,399 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 13:01:42,399 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 13:01:42,400 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 13:01:42,400 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:01:42,401 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:01:42,401 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:01:42,402 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:01:42,402 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:01:42,402 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:01:42,403 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:01:42,537 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0004_000001 (auth:SIMPLE) 2023-09-24 13:01:42,797 WARN [Listener at jenkins-hbase4.apache.org/34119] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 13:01:42,799 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-24 13:01:42,801 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-24 13:01:42,856 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 13:01:42,856 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 13:01:43,250 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 13:01:43,383 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0005_000001 (auth:SIMPLE) 2023-09-24 13:01:47,110 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0005_000001 (auth:SIMPLE) 2023-09-24 13:01:49,319 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0005_000001 (auth:SIMPLE) 2023-09-24 13:01:51,660 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0005_000001 (auth:SIMPLE) 2023-09-24 13:01:52,954 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 13:01:52,957 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 13:01:52,966 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:52,966 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 13:01:52,966 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 13:01:52,966 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1579157240_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:52,967 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-24 13:01:52,967 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-24 13:01:52,967 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1579157240_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560501408/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560501408/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:52,968 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560501408/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-24 13:01:52,968 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560501408/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-24 13:01:52,975 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:52,975 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:52,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:52,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-24 13:01:52,980 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560512979"}]},"ts":"1695560512979"} 2023-09-24 13:01:52,981 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-24 13:01:52,983 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-24 13:01:52,983 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c875522733bc59e9c91dca5abdea4d91, UNASSIGN}] 2023-09-24 13:01:52,985 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c875522733bc59e9c91dca5abdea4d91, UNASSIGN 2023-09-24 13:01:52,986 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c875522733bc59e9c91dca5abdea4d91, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:52,986 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695560512986"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560512986"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560512986"}]},"ts":"1695560512986"} 2023-09-24 13:01:52,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure c875522733bc59e9c91dca5abdea4d91, server=jenkins-hbase4.apache.org,44885,1695560427276}] 2023-09-24 13:01:53,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-24 13:01:53,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c875522733bc59e9c91dca5abdea4d91 2023-09-24 13:01:53,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c875522733bc59e9c91dca5abdea4d91, disabling compactions & flushes 2023-09-24 13:01:53,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91. 2023-09-24 13:01:53,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91. 2023-09-24 13:01:53,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91. after waiting 0 ms 2023-09-24 13:01:53,140 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91. 2023-09-24 13:01:53,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-24 13:01:53,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:01:53,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91. 2023-09-24 13:01:53,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c875522733bc59e9c91dca5abdea4d91: 2023-09-24 13:01:53,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c875522733bc59e9c91dca5abdea4d91 2023-09-24 13:01:53,154 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=c875522733bc59e9c91dca5abdea4d91, regionState=CLOSED 2023-09-24 13:01:53,154 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695560513154"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560513154"}]},"ts":"1695560513154"} 2023-09-24 13:01:53,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-24 13:01:53,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure c875522733bc59e9c91dca5abdea4d91, server=jenkins-hbase4.apache.org,44885,1695560427276 in 168 msec 2023-09-24 13:01:53,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-24 13:01:53,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c875522733bc59e9c91dca5abdea4d91, UNASSIGN in 174 msec 2023-09-24 13:01:53,159 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560513159"}]},"ts":"1695560513159"} 2023-09-24 13:01:53,160 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-24 13:01:53,161 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-24 13:01:53,163 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 187 msec 2023-09-24 13:01:53,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-24 13:01:53,282 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-24 13:01:53,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,286 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,286 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,288 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35765] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,290 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,290 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,290 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,290 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,291 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91 2023-09-24 13:01:53,291 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-24 13:01:53,291 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-24 13:01:53,291 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-24 13:01:53,291 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-24 13:01:53,291 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2 2023-09-24 13:01:53,291 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d 2023-09-24 13:01:53,293 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d/cf, FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d/recovered.edits] 2023-09-24 13:01:53,293 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/cf, FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/recovered.edits] 2023-09-24 13:01:53,293 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,293 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,293 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,293 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:53,293 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:53,293 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,293 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:53,293 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:53,293 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2/cf, FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2/recovered.edits] 2023-09-24 13:01:53,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:53,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:53,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-24 13:01:53,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:53,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:53,298 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d/cf/9f8777782a1a4178969b9f4de548ff71 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d/cf/9f8777782a1a4178969b9f4de548ff71 2023-09-24 13:01:53,298 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/cf/9020b594996c4ff7b1c6b3939c1d3563.f0edd62a504bfd813817c41c56611de2 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/cf/9020b594996c4ff7b1c6b3939c1d3563.f0edd62a504bfd813817c41c56611de2 2023-09-24 13:01:53,298 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2/cf/9020b594996c4ff7b1c6b3939c1d3563 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2/cf/9020b594996c4ff7b1c6b3939c1d3563 2023-09-24 13:01:53,302 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/cf/9f8777782a1a4178969b9f4de548ff71.52b4057bf796e89ab25e6566a46c454d to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/cf/9f8777782a1a4178969b9f4de548ff71.52b4057bf796e89ab25e6566a46c454d 2023-09-24 13:01:53,304 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d/recovered.edits/8.seqid to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d/recovered.edits/8.seqid 2023-09-24 13:01:53,304 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2/recovered.edits/8.seqid to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2/recovered.edits/8.seqid 2023-09-24 13:01:53,304 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/52b4057bf796e89ab25e6566a46c454d 2023-09-24 13:01:53,304 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f0edd62a504bfd813817c41c56611de2 2023-09-24 13:01:53,305 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/recovered.edits/12.seqid to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91/recovered.edits/12.seqid 2023-09-24 13:01:53,306 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c875522733bc59e9c91dca5abdea4d91 2023-09-24 13:01:53,306 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-24 13:01:53,307 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,310 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-24 13:01:53,311 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-24 13:01:53,312 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,312 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-24 13:01:53,312 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695560513312"}]},"ts":"9223372036854775807"} 2023-09-24 13:01:53,314 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-24 13:01:53,314 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c875522733bc59e9c91dca5abdea4d91, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695560499322.c875522733bc59e9c91dca5abdea4d91.', STARTKEY => '', ENDKEY => ''}] 2023-09-24 13:01:53,314 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-24 13:01:53,314 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695560513314"}]},"ts":"9223372036854775807"} 2023-09-24 13:01:53,315 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-24 13:01:53,318 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 35 msec 2023-09-24 13:01:53,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-24 13:01:53,396 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-24 13:01:53,396 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-24 13:01:53,401 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560513401"}]},"ts":"1695560513401"} 2023-09-24 13:01:53,402 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-24 13:01:53,404 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-24 13:01:53,404 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b6723dbdc55f57a0aa1c1280b733c97b, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=674542588f805a51bf30fe8dd69eefb7, UNASSIGN}] 2023-09-24 13:01:53,406 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b6723dbdc55f57a0aa1c1280b733c97b, UNASSIGN 2023-09-24 13:01:53,406 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=674542588f805a51bf30fe8dd69eefb7, UNASSIGN 2023-09-24 13:01:53,407 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=b6723dbdc55f57a0aa1c1280b733c97b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:53,407 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=674542588f805a51bf30fe8dd69eefb7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:53,407 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695560513407"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560513407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560513407"}]},"ts":"1695560513407"} 2023-09-24 13:01:53,407 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695560513407"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560513407"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560513407"}]},"ts":"1695560513407"} 2023-09-24 13:01:53,409 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure b6723dbdc55f57a0aa1c1280b733c97b, server=jenkins-hbase4.apache.org,44885,1695560427276}] 2023-09-24 13:01:53,409 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 674542588f805a51bf30fe8dd69eefb7, server=jenkins-hbase4.apache.org,40801,1695560427220}] 2023-09-24 13:01:53,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-24 13:01:53,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b6723dbdc55f57a0aa1c1280b733c97b 2023-09-24 13:01:53,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 674542588f805a51bf30fe8dd69eefb7 2023-09-24 13:01:53,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b6723dbdc55f57a0aa1c1280b733c97b, disabling compactions & flushes 2023-09-24 13:01:53,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:53,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 674542588f805a51bf30fe8dd69eefb7, disabling compactions & flushes 2023-09-24 13:01:53,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:53,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. 2023-09-24 13:01:53,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. after waiting 0 ms 2023-09-24 13:01:53,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:53,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. 2023-09-24 13:01:53,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. after waiting 0 ms 2023-09-24 13:01:53,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. 2023-09-24 13:01:53,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 13:01:53,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 13:01:53,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:01:53,572 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:01:53,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7. 2023-09-24 13:01:53,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b. 2023-09-24 13:01:53,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 674542588f805a51bf30fe8dd69eefb7: 2023-09-24 13:01:53,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b6723dbdc55f57a0aa1c1280b733c97b: 2023-09-24 13:01:53,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 674542588f805a51bf30fe8dd69eefb7 2023-09-24 13:01:53,575 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=674542588f805a51bf30fe8dd69eefb7, regionState=CLOSED 2023-09-24 13:01:53,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b6723dbdc55f57a0aa1c1280b733c97b 2023-09-24 13:01:53,576 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695560513575"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560513575"}]},"ts":"1695560513575"} 2023-09-24 13:01:53,576 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=b6723dbdc55f57a0aa1c1280b733c97b, regionState=CLOSED 2023-09-24 13:01:53,576 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695560513576"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560513576"}]},"ts":"1695560513576"} 2023-09-24 13:01:53,578 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-24 13:01:53,579 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 674542588f805a51bf30fe8dd69eefb7, server=jenkins-hbase4.apache.org,40801,1695560427220 in 168 msec 2023-09-24 13:01:53,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-24 13:01:53,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure b6723dbdc55f57a0aa1c1280b733c97b, server=jenkins-hbase4.apache.org,44885,1695560427276 in 169 msec 2023-09-24 13:01:53,580 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=674542588f805a51bf30fe8dd69eefb7, UNASSIGN in 175 msec 2023-09-24 13:01:53,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-24 13:01:53,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b6723dbdc55f57a0aa1c1280b733c97b, UNASSIGN in 175 msec 2023-09-24 13:01:53,581 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560513581"}]},"ts":"1695560513581"} 2023-09-24 13:01:53,582 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-24 13:01:53,584 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-24 13:01:53,585 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 187 msec 2023-09-24 13:01:53,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-24 13:01:53,703 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-24 13:01:53,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,707 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,708 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,709 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35765] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,712 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b 2023-09-24 13:01:53,712 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,712 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,712 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7 2023-09-24 13:01:53,712 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,712 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,712 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-24 13:01:53,712 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-24 13:01:53,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-24 13:01:53,713 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-24 13:01:53,714 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,714 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,714 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,714 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:53,714 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:53,714 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,714 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:53,714 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:53,714 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b/cf, FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b/recovered.edits] 2023-09-24 13:01:53,715 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7/cf, FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7/recovered.edits] 2023-09-24 13:01:53,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-24 13:01:53,719 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b/cf/374402cfe6d64e8ab8f25bd6ad6138ae to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b/cf/374402cfe6d64e8ab8f25bd6ad6138ae 2023-09-24 13:01:53,719 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7/cf/cc3f9257094548488002754af685f571 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7/cf/cc3f9257094548488002754af685f571 2023-09-24 13:01:53,721 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b/recovered.edits/9.seqid to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b/recovered.edits/9.seqid 2023-09-24 13:01:53,721 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7/recovered.edits/9.seqid to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7/recovered.edits/9.seqid 2023-09-24 13:01:53,722 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b6723dbdc55f57a0aa1c1280b733c97b 2023-09-24 13:01:53,722 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/674542588f805a51bf30fe8dd69eefb7 2023-09-24 13:01:53,722 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-24 13:01:53,722 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-24 13:01:53,723 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-24 13:01:53,726 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230924221b18d675e642b5a7f3235b54acae6a to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230924221b18d675e642b5a7f3235b54acae6a 2023-09-24 13:01:53,727 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230924bf365779910b4339a979e6fbde949ee0 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230924bf365779910b4339a979e6fbde949ee0 2023-09-24 13:01:53,727 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-24 13:01:53,729 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,731 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-24 13:01:53,733 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-24 13:01:53,734 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,734 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-24 13:01:53,734 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695560513734"}]},"ts":"9223372036854775807"} 2023-09-24 13:01:53,734 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695560513734"}]},"ts":"9223372036854775807"} 2023-09-24 13:01:53,735 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 13:01:53,735 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b6723dbdc55f57a0aa1c1280b733c97b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695560497956.b6723dbdc55f57a0aa1c1280b733c97b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 674542588f805a51bf30fe8dd69eefb7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695560497956.674542588f805a51bf30fe8dd69eefb7.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 13:01:53,735 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-24 13:01:53,735 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695560513735"}]},"ts":"9223372036854775807"} 2023-09-24 13:01:53,737 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-24 13:01:53,739 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,740 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 35 msec 2023-09-24 13:01:53,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-24 13:01:53,817 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-24 13:01:53,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-24 13:01:53,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-24 13:01:53,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-24 13:01:53,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-24 13:01:53,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-24 13:01:53,856 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 749) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1579157240_17 at /127.0.0.1:55192 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1579157240_17 at /127.0.0.1:48954 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1579157240_17 at /127.0.0.1:49142 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1690691818_1 at /127.0.0.1:48912 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3959 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:39411 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=129 (was 101) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=7260 (was 7365) 2023-09-24 13:01:53,856 WARN [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-24 13:01:53,875 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=129, ProcessCount=168, AvailableMemoryMB=7259 2023-09-24 13:01:53,876 WARN [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-24 13:01:53,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 13:01:53,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 13:01:53,880 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 13:01:53,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-24 13:01:53,881 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 13:01:53,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-24 13:01:53,883 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea 2023-09-24 13:01:53,883 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3 2023-09-24 13:01:53,883 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea empty. 2023-09-24 13:01:53,883 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3 empty. 2023-09-24 13:01:53,884 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea 2023-09-24 13:01:53,884 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3 2023-09-24 13:01:53,884 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-24 13:01:53,893 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-24 13:01:53,894 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0a482ea93ee1c568ad13febdc7538bea, NAME => 'testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp 2023-09-24 13:01:53,894 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 19923d06af4a12f9eaece2d4406652d3, NAME => 'testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp 2023-09-24 13:01:53,904 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:53,904 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:53,904 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 0a482ea93ee1c568ad13febdc7538bea, disabling compactions & flushes 2023-09-24 13:01:53,904 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 19923d06af4a12f9eaece2d4406652d3, disabling compactions & flushes 2023-09-24 13:01:53,904 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:01:53,905 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. 2023-09-24 13:01:53,905 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:01:53,905 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. 2023-09-24 13:01:53,905 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. after waiting 0 ms 2023-09-24 13:01:53,905 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. after waiting 0 ms 2023-09-24 13:01:53,905 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. 2023-09-24 13:01:53,905 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:01:53,905 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. 2023-09-24 13:01:53,905 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:01:53,905 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 19923d06af4a12f9eaece2d4406652d3: 2023-09-24 13:01:53,905 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 0a482ea93ee1c568ad13febdc7538bea: 2023-09-24 13:01:53,907 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 13:01:53,908 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695560513907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560513907"}]},"ts":"1695560513907"} 2023-09-24 13:01:53,908 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695560513907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560513907"}]},"ts":"1695560513907"} 2023-09-24 13:01:53,909 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 13:01:53,910 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 13:01:53,910 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560513910"}]},"ts":"1695560513910"} 2023-09-24 13:01:53,911 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-24 13:01:53,915 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 13:01:53,916 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 13:01:53,916 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 13:01:53,916 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 13:01:53,916 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 13:01:53,916 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0a482ea93ee1c568ad13febdc7538bea, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=19923d06af4a12f9eaece2d4406652d3, ASSIGN}] 2023-09-24 13:01:53,918 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=19923d06af4a12f9eaece2d4406652d3, ASSIGN 2023-09-24 13:01:53,918 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0a482ea93ee1c568ad13febdc7538bea, ASSIGN 2023-09-24 13:01:53,919 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=19923d06af4a12f9eaece2d4406652d3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44885,1695560427276; forceNewPlan=false, retain=false 2023-09-24 13:01:53,919 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0a482ea93ee1c568ad13febdc7538bea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35765,1695560427316; forceNewPlan=false, retain=false 2023-09-24 13:01:53,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-24 13:01:54,069 INFO [jenkins-hbase4:39481] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 13:01:54,072 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=19923d06af4a12f9eaece2d4406652d3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,072 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0a482ea93ee1c568ad13febdc7538bea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,072 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695560514072"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560514072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560514072"}]},"ts":"1695560514072"} 2023-09-24 13:01:54,072 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695560514072"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560514072"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560514072"}]},"ts":"1695560514072"} 2023-09-24 13:01:54,074 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 19923d06af4a12f9eaece2d4406652d3, server=jenkins-hbase4.apache.org,44885,1695560427276}] 2023-09-24 13:01:54,075 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 0a482ea93ee1c568ad13febdc7538bea, server=jenkins-hbase4.apache.org,35765,1695560427316}] 2023-09-24 13:01:54,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-24 13:01:54,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. 2023-09-24 13:01:54,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 19923d06af4a12f9eaece2d4406652d3, NAME => 'testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 13:01:54,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. service=AccessControlService 2023-09-24 13:01:54,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:01:54,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 19923d06af4a12f9eaece2d4406652d3 2023-09-24 13:01:54,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:54,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 19923d06af4a12f9eaece2d4406652d3 2023-09-24 13:01:54,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 19923d06af4a12f9eaece2d4406652d3 2023-09-24 13:01:54,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:01:54,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0a482ea93ee1c568ad13febdc7538bea, NAME => 'testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 13:01:54,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. service=AccessControlService 2023-09-24 13:01:54,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:01:54,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 0a482ea93ee1c568ad13febdc7538bea 2023-09-24 13:01:54,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:01:54,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0a482ea93ee1c568ad13febdc7538bea 2023-09-24 13:01:54,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0a482ea93ee1c568ad13febdc7538bea 2023-09-24 13:01:54,233 INFO [StoreOpener-19923d06af4a12f9eaece2d4406652d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 19923d06af4a12f9eaece2d4406652d3 2023-09-24 13:01:54,234 INFO [StoreOpener-0a482ea93ee1c568ad13febdc7538bea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0a482ea93ee1c568ad13febdc7538bea 2023-09-24 13:01:54,234 DEBUG [StoreOpener-19923d06af4a12f9eaece2d4406652d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3/cf 2023-09-24 13:01:54,234 DEBUG [StoreOpener-19923d06af4a12f9eaece2d4406652d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3/cf 2023-09-24 13:01:54,235 INFO [StoreOpener-19923d06af4a12f9eaece2d4406652d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19923d06af4a12f9eaece2d4406652d3 columnFamilyName cf 2023-09-24 13:01:54,235 DEBUG [StoreOpener-0a482ea93ee1c568ad13febdc7538bea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea/cf 2023-09-24 13:01:54,235 DEBUG [StoreOpener-0a482ea93ee1c568ad13febdc7538bea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea/cf 2023-09-24 13:01:54,236 INFO [StoreOpener-0a482ea93ee1c568ad13febdc7538bea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a482ea93ee1c568ad13febdc7538bea columnFamilyName cf 2023-09-24 13:01:54,236 INFO [StoreOpener-19923d06af4a12f9eaece2d4406652d3-1] regionserver.HStore(310): Store=19923d06af4a12f9eaece2d4406652d3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:01:54,236 INFO [StoreOpener-0a482ea93ee1c568ad13febdc7538bea-1] regionserver.HStore(310): Store=0a482ea93ee1c568ad13febdc7538bea/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:01:54,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3 2023-09-24 13:01:54,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea 2023-09-24 13:01:54,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3 2023-09-24 13:01:54,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea 2023-09-24 13:01:54,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 19923d06af4a12f9eaece2d4406652d3 2023-09-24 13:01:54,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0a482ea93ee1c568ad13febdc7538bea 2023-09-24 13:01:54,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:01:54,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:01:54,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 19923d06af4a12f9eaece2d4406652d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72055762, jitterRate=0.07371452450752258}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:01:54,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 19923d06af4a12f9eaece2d4406652d3: 2023-09-24 13:01:54,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0a482ea93ee1c568ad13febdc7538bea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75048142, jitterRate=0.11830446124076843}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:01:54,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0a482ea93ee1c568ad13febdc7538bea: 2023-09-24 13:01:54,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3., pid=93, masterSystemTime=1695560514225 2023-09-24 13:01:54,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea., pid=94, masterSystemTime=1695560514227 2023-09-24 13:01:54,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:01:54,245 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:01:54,245 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=0a482ea93ee1c568ad13febdc7538bea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. 2023-09-24 13:01:54,246 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695560514245"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560514245"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560514245"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560514245"}]},"ts":"1695560514245"} 2023-09-24 13:01:54,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. 2023-09-24 13:01:54,246 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=19923d06af4a12f9eaece2d4406652d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,246 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695560514246"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560514246"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560514246"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560514246"}]},"ts":"1695560514246"} 2023-09-24 13:01:54,248 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-24 13:01:54,248 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 0a482ea93ee1c568ad13febdc7538bea, server=jenkins-hbase4.apache.org,35765,1695560427316 in 172 msec 2023-09-24 13:01:54,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-24 13:01:54,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 19923d06af4a12f9eaece2d4406652d3, server=jenkins-hbase4.apache.org,44885,1695560427276 in 173 msec 2023-09-24 13:01:54,249 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0a482ea93ee1c568ad13febdc7538bea, ASSIGN in 332 msec 2023-09-24 13:01:54,251 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-24 13:01:54,251 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=19923d06af4a12f9eaece2d4406652d3, ASSIGN in 333 msec 2023-09-24 13:01:54,251 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 13:01:54,251 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560514251"}]},"ts":"1695560514251"} 2023-09-24 13:01:54,252 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-24 13:01:54,254 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 13:01:54,254 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-24 13:01:54,256 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35765] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 13:01:54,257 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:54,257 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:54,257 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:54,257 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:01:54,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:54,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:54,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:54,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-24 13:01:54,260 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 382 msec 2023-09-24 13:01:54,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-24 13:01:54,484 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-24 13:01:54,487 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-24 13:01:54,487 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:01:54,489 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 13:01:54,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 13:01:54,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695560514499 (current time:1695560514499). 2023-09-24 13:01:54,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 13:01:54,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x34fb7099 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:01:54,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a1273f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:01:54,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:54,510 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:54,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34fb7099 to 127.0.0.1:55856 2023-09-24 13:01:54,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:01:54,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x05e4b207 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:01:54,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a74759a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:01:54,518 DEBUG [hconnection-0x130026e1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:54,520 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59176, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:54,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:54,526 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43114, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:54,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05e4b207 to 127.0.0.1:55856 2023-09-24 13:01:54,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:01:54,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 13:01:54,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 13:01:54,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 13:01:54,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 13:01:54,530 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 13:01:54,531 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695561114531 2023-09-24 13:01:54,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 13:01:54,531 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-24 13:01:54,532 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 13:01:54,532 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 13:01:54,533 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 13:01:54,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 13:01:54,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-24 13:01:54,537 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 13:01:54,538 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695561114538 2023-09-24 13:01:54,545 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,545 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-24 13:01:54,545 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:54,546 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-24 13:01:54,546 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-24 13:01:54,547 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,547 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,552 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:54,552 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:54,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:54,552 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:54,552 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:54,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:54,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:54,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:54,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:54,553 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,553 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,553 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,553 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 13:01:54,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-24 13:01:54,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-24 13:01:54,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-24 13:01:54,554 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 13:01:54,554 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 13:01:54,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,554 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 13:01:54,554 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,554 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,554 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 13:01:54,554 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 13:01:54,554 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:54,554 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,555 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 13:01:54,555 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 13:01:54,555 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:54,554 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:54,556 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 13:01:54,555 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 13:01:54,557 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 13:01:54,557 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 13:01:54,557 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 13:01:54,557 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 13:01:54,557 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 13:01:54,557 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 13:01:54,559 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,559 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:54,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:54,560 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,560 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,560 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,560 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:54,560 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:54,560 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,561 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:54,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:54,561 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,561 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:54,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:54,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-24 13:01:54,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a50ac67[Count = 1] remaining members to acquire global barrier 2023-09-24 13:01:54,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:54,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:54,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:54,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:54,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:54,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-24 13:01:54,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a50ac67[Count = 0] remaining members to acquire global barrier 2023-09-24 13:01:54,564 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-24 13:01:54,565 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,569 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,569 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,569 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,570 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 13:01:54,570 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,570 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 13:01:54,570 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 13:01:54,570 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 13:01:54,570 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:01:54,570 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:01:54,570 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. 2023-09-24 13:01:54,570 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:01:54,570 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. started... 2023-09-24 13:01:54,570 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:01:54,570 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. started... 2023-09-24 13:01:54,570 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:01:54,570 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,572 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 13:01:54,570 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40801,1695560427220' in zk 2023-09-24 13:01:54,572 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a482ea93ee1c568ad13febdc7538bea: 2023-09-24 13:01:54,572 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 19923d06af4a12f9eaece2d4406652d3: 2023-09-24 13:01:54,572 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,572 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:01:54,572 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,572 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 13:01:54,573 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:01:54,573 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 13:01:54,574 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 13:01:54,574 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:54,574 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 13:01:54,585 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. completed. 2023-09-24 13:01:54,585 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. 2023-09-24 13:01:54,585 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:01:54,585 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:01:54,585 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,586 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 13:01:54,586 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44885,1695560427276' in zk 2023-09-24 13:01:54,587 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 13:01:54,587 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,587 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. completed. 2023-09-24 13:01:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:54,587 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:54,587 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:01:54,588 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 13:01:54,589 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:01:54,589 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:01:54,589 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,589 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 13:01:54,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:54,589 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35765,1695560427316' in zk 2023-09-24 13:01:54,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:54,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,590 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,591 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 13:01:54,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,591 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:54,591 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 13:01:54,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:54,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44885,1695560427276': 2023-09-24 13:01:54,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-24 13:01:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35765,1695560427316': 2023-09-24 13:01:54,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-24 13:01:54,596 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-24 13:01:54,596 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 13:01:54,596 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 13:01:54,596 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,596 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 13:01:54,599 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,599 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,599 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:54,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,599 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,599 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:54,599 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,599 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,599 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:54,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,600 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:54,600 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:54,606 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,606 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,606 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,609 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,609 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:54,609 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:54,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:54,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:54,609 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:54,609 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:54,609 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,609 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:54,609 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:54,609 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:54,609 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,609 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:54,609 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-24 13:01:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:54,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,609 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:54,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 13:01:54,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:54,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:54,611 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,611 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,611 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,611 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,611 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,611 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,611 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,612 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 13:01:54,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,632 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:01:54,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 13:01:54,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-24 13:01:54,634 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 13:01:54,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,637 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-24 13:01:54,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,638 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695560514531Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695560514619 (+88 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695560514619Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695560514619Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695560514622 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695560514629 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695560514637 (+8 ms) 2023-09-24 13:01:54,641 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 13:01:54,642 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 109 msec 2023-09-24 13:01:54,834 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:01:54,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 13:01:54,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 13:01:54,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35765] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 13:01:54,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44885] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 13:01:54,840 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-24 13:01:54,841 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:01:54,841 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 13:01:54,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 13:01:54,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695560514850 (current time:1695560514850). 2023-09-24 13:01:54,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 13:01:54,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x505ea0c7 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:01:54,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@427ba303, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:01:54,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:54,861 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:54,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x505ea0c7 to 127.0.0.1:55856 2023-09-24 13:01:54,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:01:54,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x45e5afbc to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:01:54,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6098675f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:01:54,870 DEBUG [hconnection-0x7fe4b3f4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:54,870 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:54,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:01:54,875 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:01:54,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45e5afbc to 127.0.0.1:55856 2023-09-24 13:01:54,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:01:54,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-24 13:01:54,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 13:01:54,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 13:01:54,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 13:01:54,880 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 13:01:54,881 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695561114881 2023-09-24 13:01:54,881 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-24 13:01:54,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-24 13:01:54,882 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 13:01:54,882 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 13:01:54,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 13:01:54,883 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-24 13:01:54,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-24 13:01:54,885 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 13:01:54,885 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695561114885 2023-09-24 13:01:54,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,893 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-24 13:01:54,893 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:54,894 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-24 13:01:54,894 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-24 13:01:54,895 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,895 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,896 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:54,896 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:54,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:54,896 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,896 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:54,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:54,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:54,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:54,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:54,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:54,897 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,897 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,897 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,897 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 13:01:54,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-24 13:01:54,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-24 13:01:54,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-24 13:01:54,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 13:01:54,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 13:01:54,898 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-24 13:01:54,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,898 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 13:01:54,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,898 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:54,898 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 13:01:54,899 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:54,899 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 13:01:54,898 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-24 13:01:54,900 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:01:54,900 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 13:01:54,900 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 13:01:54,903 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 13:01:54,903 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 13:01:54,903 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 13:01:54,903 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-24 13:01:54,903 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-24 13:01:54,903 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-24 13:01:54,905 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,905 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,905 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:54,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:54,905 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,907 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:54,907 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,907 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,907 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:54,907 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:54,907 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,907 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:01:54,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:54,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-24 13:01:54,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12e58a61[Count = 1] remaining members to acquire global barrier 2023-09-24 13:01:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:54,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-24 13:01:54,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12e58a61[Count = 0] remaining members to acquire global barrier 2023-09-24 13:01:54,910 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-24 13:01:54,911 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,914 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,914 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,914 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,914 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,914 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 13:01:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,914 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 13:01:54,915 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-24 13:01:54,915 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 13:01:54,915 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:01:54,915 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:01:54,915 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:01:54,915 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40801,1695560427220' in zk 2023-09-24 13:01:54,915 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. started... 2023-09-24 13:01:54,915 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. 2023-09-24 13:01:54,915 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,915 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. started... 2023-09-24 13:01:54,915 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0a482ea93ee1c568ad13febdc7538bea 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-24 13:01:54,915 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 13:01:54,915 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:01:54,915 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:01:54,915 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 19923d06af4a12f9eaece2d4406652d3 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-24 13:01:54,916 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 13:01:54,916 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:54,916 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 13:01:54,933 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230924d548c6ebb6234c56afb781d986f21e92 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230924d548c6ebb6234c56afb781d986f21e92 2023-09-24 13:01:54,933 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092474964c05b1c6438e9433a5a9cd713d4c to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092474964c05b1c6438e9433a5a9cd713d4c 2023-09-24 13:01:54,940 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea/.tmp/cf/f9a6d4bde8294feea567bd94db589d1b 2023-09-24 13:01:54,941 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3/.tmp/cf/cc0908624da74044a822485a9afec90e 2023-09-24 13:01:54,945 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea/.tmp/cf/f9a6d4bde8294feea567bd94db589d1b as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea/cf/f9a6d4bde8294feea567bd94db589d1b 2023-09-24 13:01:54,945 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3/.tmp/cf/cc0908624da74044a822485a9afec90e as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3/cf/cc0908624da74044a822485a9afec90e 2023-09-24 13:01:54,950 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3/cf/cc0908624da74044a822485a9afec90e, entries=45, sequenceid=6, filesize=12.7 K 2023-09-24 13:01:54,950 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea/cf/f9a6d4bde8294feea567bd94db589d1b, entries=5, sequenceid=6, filesize=5.8 K 2023-09-24 13:01:54,951 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 0a482ea93ee1c568ad13febdc7538bea in 36ms, sequenceid=6, compaction requested=false 2023-09-24 13:01:54,951 INFO [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 19923d06af4a12f9eaece2d4406652d3 in 36ms, sequenceid=6, compaction requested=false 2023-09-24 13:01:54,951 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-24 13:01:54,951 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-24 13:01:54,954 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a482ea93ee1c568ad13febdc7538bea: 2023-09-24 13:01:54,954 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 19923d06af4a12f9eaece2d4406652d3: 2023-09-24 13:01:54,955 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,955 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,956 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:01:54,956 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:01:54,956 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea/cf/f9a6d4bde8294feea567bd94db589d1b] hfiles 2023-09-24 13:01:54,956 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3/cf/cc0908624da74044a822485a9afec90e] hfiles 2023-09-24 13:01:54,956 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea/cf/f9a6d4bde8294feea567bd94db589d1b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,956 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3/cf/cc0908624da74044a822485a9afec90e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,965 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. completed. 2023-09-24 13:01:54,965 DEBUG [rs(jenkins-hbase4.apache.org,44885,1695560427276)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. 2023-09-24 13:01:54,965 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:01:54,966 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:01:54,967 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,967 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 13:01:54,967 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,44885,1695560427276' in zk 2023-09-24 13:01:54,968 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,968 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 13:01:54,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:54,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:54,968 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:54,968 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 13:01:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:54,970 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. completed. 2023-09-24 13:01:54,970 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:01:54,970 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:01:54,970 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:01:54,970 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,970 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-24 13:01:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:54,970 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35765,1695560427316' in zk 2023-09-24 13:01:54,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,972 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,973 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-24 13:01:54,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,973 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:54,973 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-24 13:01:54,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:54,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,44885,1695560427276': 2023-09-24 13:01:54,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-24 13:01:54,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:54,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:54,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:54,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:54,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:54,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35765,1695560427316': 2023-09-24 13:01:54,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-24 13:01:54,979 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-24 13:01:54,979 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 13:01:54,979 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 13:01:54,979 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,979 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 13:01:54,981 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,981 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,981 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:54,981 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,981 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:01:54,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:01:54,981 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:54,981 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:54,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:54,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:54,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:01:54,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:54,981 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:54,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:54,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:54,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,982 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,982 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:01:54,982 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:01:54,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 13:01:54,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-24 13:01:54,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,983 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 13:01:54,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,984 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:01:54,984 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,984 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,987 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,987 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,987 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,987 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:54,987 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:54,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:54,987 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:54,987 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,987 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,987 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,987 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-24 13:01:54,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:54,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:54,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,987 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:54,987 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:01:54,987 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:01:54,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 13:01:54,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:01:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:01:54,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:54,987 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:01:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:54,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:54,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:54,989 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:01:54,989 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,989 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:01:54,989 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:01:54,989 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,989 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:01:54,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092474964c05b1c6438e9433a5a9cd713d4c, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230924d548c6ebb6234c56afb781d986f21e92] mob files 2023-09-24 13:01:54,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:01:54,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092474964c05b1c6438e9433a5a9cd713d4c 2023-09-24 13:01:54,990 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230924d548c6ebb6234c56afb781d986f21e92 2023-09-24 13:01:54,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:54,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:55,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:55,024 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-24 13:01:55,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:55,025 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:55,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695560514881Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695560514996 (+115 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695560514996Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695560514996Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695560515000 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695560515017 (+17 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695560515024 (+7 ms) 2023-09-24 13:01:55,031 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-24 13:01:55,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 150 msec 2023-09-24 13:01:55,183 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:01:55,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-24 13:01:55,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 13:01:55,185 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560515185 2023-09-24 13:01:55,185 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36659, tgtDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560515185, rawTgtDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560515185, srcFsUri=hdfs://localhost:36659, srcDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:01:55,206 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36659, inputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:01:55,206 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_169041113_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560515185, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560515185/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:55,206 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36659, inputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68, snapshotDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-24 13:01:55,211 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560515185/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:01:55,230 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:55,231 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:55,231 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:55,231 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:56,103 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop-4884714697402731386.jar 2023-09-24 13:01:56,103 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:56,104 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:56,170 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop-5572638431367468492.jar 2023-09-24 13:01:56,170 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:56,171 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:56,171 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:56,171 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:56,172 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:56,172 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 13:01:56,172 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 13:01:56,172 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 13:01:56,173 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 13:01:56,173 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 13:01:56,173 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 13:01:56,174 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 13:01:56,174 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 13:01:56,175 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 13:01:56,175 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 13:01:56,175 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 13:01:56,176 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:01:56,176 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:01:56,177 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:01:56,177 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:01:56,177 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:01:56,178 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:01:56,178 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:01:56,513 WARN [Listener at jenkins-hbase4.apache.org/34119] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 13:01:56,515 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-24 13:01:57,832 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 13:01:57,832 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 13:01:57,836 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0005_000001 (auth:SIMPLE) 2023-09-24 13:01:58,545 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0006_000001 (auth:SIMPLE) 2023-09-24 13:01:58,739 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 13:02:02,355 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0006_000001 (auth:SIMPLE) 2023-09-24 13:02:04,845 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 13:02:04,846 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 13:02:04,850 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:02:04,851 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 13:02:04,851 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 13:02:04,851 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1579157240_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:02:04,852 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-24 13:02:04,852 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-24 13:02:04,852 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1579157240_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560515185/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560515185/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:02:04,852 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560515185/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-24 13:02:04,852 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560515185/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-24 13:02:04,857 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-24 13:02:04,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-24 13:02:04,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 13:02:04,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-24 13:02:04,861 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560524861"}]},"ts":"1695560524861"} 2023-09-24 13:02:04,862 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-24 13:02:04,864 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-24 13:02:04,865 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0a482ea93ee1c568ad13febdc7538bea, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=19923d06af4a12f9eaece2d4406652d3, UNASSIGN}] 2023-09-24 13:02:04,867 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0a482ea93ee1c568ad13febdc7538bea, UNASSIGN 2023-09-24 13:02:04,867 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=19923d06af4a12f9eaece2d4406652d3, UNASSIGN 2023-09-24 13:02:04,868 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0a482ea93ee1c568ad13febdc7538bea, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:04,868 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=19923d06af4a12f9eaece2d4406652d3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:04,868 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695560524868"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560524868"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560524868"}]},"ts":"1695560524868"} 2023-09-24 13:02:04,868 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695560524868"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560524868"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560524868"}]},"ts":"1695560524868"} 2023-09-24 13:02:04,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 0a482ea93ee1c568ad13febdc7538bea, server=jenkins-hbase4.apache.org,35765,1695560427316}] 2023-09-24 13:02:04,870 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 19923d06af4a12f9eaece2d4406652d3, server=jenkins-hbase4.apache.org,44885,1695560427276}] 2023-09-24 13:02:04,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-24 13:02:05,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 19923d06af4a12f9eaece2d4406652d3 2023-09-24 13:02:05,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0a482ea93ee1c568ad13febdc7538bea 2023-09-24 13:02:05,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 19923d06af4a12f9eaece2d4406652d3, disabling compactions & flushes 2023-09-24 13:02:05,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0a482ea93ee1c568ad13febdc7538bea, disabling compactions & flushes 2023-09-24 13:02:05,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. 2023-09-24 13:02:05,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:02:05,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:02:05,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. 2023-09-24 13:02:05,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. after waiting 0 ms 2023-09-24 13:02:05,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:02:05,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. after waiting 0 ms 2023-09-24 13:02:05,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. 2023-09-24 13:02:05,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 13:02:05,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 13:02:05,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:02:05,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:02:05,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea. 2023-09-24 13:02:05,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3. 2023-09-24 13:02:05,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0a482ea93ee1c568ad13febdc7538bea: 2023-09-24 13:02:05,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 19923d06af4a12f9eaece2d4406652d3: 2023-09-24 13:02:05,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 19923d06af4a12f9eaece2d4406652d3 2023-09-24 13:02:05,032 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=19923d06af4a12f9eaece2d4406652d3, regionState=CLOSED 2023-09-24 13:02:05,033 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695560525032"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560525032"}]},"ts":"1695560525032"} 2023-09-24 13:02:05,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0a482ea93ee1c568ad13febdc7538bea 2023-09-24 13:02:05,033 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=0a482ea93ee1c568ad13febdc7538bea, regionState=CLOSED 2023-09-24 13:02:05,033 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695560525033"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560525033"}]},"ts":"1695560525033"} 2023-09-24 13:02:05,035 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-24 13:02:05,035 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 19923d06af4a12f9eaece2d4406652d3, server=jenkins-hbase4.apache.org,44885,1695560427276 in 164 msec 2023-09-24 13:02:05,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-24 13:02:05,036 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=19923d06af4a12f9eaece2d4406652d3, UNASSIGN in 170 msec 2023-09-24 13:02:05,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 0a482ea93ee1c568ad13febdc7538bea, server=jenkins-hbase4.apache.org,35765,1695560427316 in 165 msec 2023-09-24 13:02:05,038 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-24 13:02:05,038 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0a482ea93ee1c568ad13febdc7538bea, UNASSIGN in 171 msec 2023-09-24 13:02:05,038 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560525038"}]},"ts":"1695560525038"} 2023-09-24 13:02:05,039 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-24 13:02:05,041 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-24 13:02:05,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 184 msec 2023-09-24 13:02:05,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-24 13:02:05,163 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-24 13:02:05,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,167 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,167 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,169 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35765] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,171 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea 2023-09-24 13:02:05,171 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3 2023-09-24 13:02:05,173 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,173 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,173 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,173 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,173 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-24 13:02:05,173 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-24 13:02:05,173 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-24 13:02:05,173 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3/cf, FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3/recovered.edits] 2023-09-24 13:02:05,173 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-24 13:02:05,174 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea/cf, FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea/recovered.edits] 2023-09-24 13:02:05,174 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,174 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,174 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,175 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:02:05,174 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,175 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:02:05,174 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:02:05,175 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:02:05,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-24 13:02:05,178 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3/cf/cc0908624da74044a822485a9afec90e to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3/cf/cc0908624da74044a822485a9afec90e 2023-09-24 13:02:05,178 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea/cf/f9a6d4bde8294feea567bd94db589d1b to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea/cf/f9a6d4bde8294feea567bd94db589d1b 2023-09-24 13:02:05,180 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3/recovered.edits/9.seqid to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3/recovered.edits/9.seqid 2023-09-24 13:02:05,181 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea/recovered.edits/9.seqid to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea/recovered.edits/9.seqid 2023-09-24 13:02:05,181 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/19923d06af4a12f9eaece2d4406652d3 2023-09-24 13:02:05,181 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testEmptyExportFileSystemState/0a482ea93ee1c568ad13febdc7538bea 2023-09-24 13:02:05,181 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-24 13:02:05,182 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-24 13:02:05,182 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-24 13:02:05,185 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092474964c05b1c6438e9433a5a9cd713d4c to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092474964c05b1c6438e9433a5a9cd713d4c 2023-09-24 13:02:05,186 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230924d548c6ebb6234c56afb781d986f21e92 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230924d548c6ebb6234c56afb781d986f21e92 2023-09-24 13:02:05,187 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-24 13:02:05,188 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,190 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-24 13:02:05,192 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-24 13:02:05,193 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,193 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-24 13:02:05,193 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695560525193"}]},"ts":"9223372036854775807"} 2023-09-24 13:02:05,193 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695560525193"}]},"ts":"9223372036854775807"} 2023-09-24 13:02:05,195 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 13:02:05,195 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0a482ea93ee1c568ad13febdc7538bea, NAME => 'testtb-testEmptyExportFileSystemState,,1695560513877.0a482ea93ee1c568ad13febdc7538bea.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 19923d06af4a12f9eaece2d4406652d3, NAME => 'testtb-testEmptyExportFileSystemState,1,1695560513877.19923d06af4a12f9eaece2d4406652d3.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 13:02:05,195 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-24 13:02:05,195 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695560525195"}]},"ts":"9223372036854775807"} 2023-09-24 13:02:05,196 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-24 13:02:05,198 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-24 13:02:05,199 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 34 msec 2023-09-24 13:02:05,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-24 13:02:05,277 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-24 13:02:05,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-24 13:02:05,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-24 13:02:05,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-24 13:02:05,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-24 13:02:05,311 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 758) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-567405534_1 at /127.0.0.1:51224 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1579157240_17 at /127.0.0.1:57026 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1579157240_17 at /127.0.0.1:59758 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:35785 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:44477 from appattempt_1695560433631_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1579157240_17 at /127.0.0.1:53474 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-567405534_1 at /127.0.0.1:53442 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4612 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:32955 from appattempt_1695560433631_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=928 (was 913) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=141 (was 129) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=7211 (was 7259) 2023-09-24 13:02:05,311 WARN [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-24 13:02:05,330 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=141, ProcessCount=168, AvailableMemoryMB=7211 2023-09-24 13:02:05,330 WARN [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-24 13:02:05,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-24 13:02:05,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:05,334 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-24 13:02:05,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-24 13:02:05,335 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-24 13:02:05,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-24 13:02:05,337 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f 2023-09-24 13:02:05,337 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b 2023-09-24 13:02:05,337 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f empty. 2023-09-24 13:02:05,338 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b empty. 2023-09-24 13:02:05,338 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f 2023-09-24 13:02:05,338 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b 2023-09-24 13:02:05,338 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-24 13:02:05,347 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-24 13:02:05,348 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 51a41e96946b38614e7e42e54cf5ee9f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp 2023-09-24 13:02:05,348 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9480933da6470a233a0ca1eb653a0f4b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp 2023-09-24 13:02:05,364 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:02:05,365 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 9480933da6470a233a0ca1eb653a0f4b, disabling compactions & flushes 2023-09-24 13:02:05,365 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. 2023-09-24 13:02:05,365 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. 2023-09-24 13:02:05,365 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. after waiting 0 ms 2023-09-24 13:02:05,365 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. 2023-09-24 13:02:05,365 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. 2023-09-24 13:02:05,365 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 9480933da6470a233a0ca1eb653a0f4b: 2023-09-24 13:02:05,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:02:05,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 51a41e96946b38614e7e42e54cf5ee9f, disabling compactions & flushes 2023-09-24 13:02:05,367 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:05,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:05,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. after waiting 0 ms 2023-09-24 13:02:05,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:05,367 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:05,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 51a41e96946b38614e7e42e54cf5ee9f: 2023-09-24 13:02:05,369 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-24 13:02:05,370 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695560525370"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560525370"}]},"ts":"1695560525370"} 2023-09-24 13:02:05,370 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695560525370"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560525370"}]},"ts":"1695560525370"} 2023-09-24 13:02:05,372 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-24 13:02:05,373 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-24 13:02:05,373 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560525373"}]},"ts":"1695560525373"} 2023-09-24 13:02:05,375 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-24 13:02:05,378 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-24 13:02:05,379 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-24 13:02:05,379 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-24 13:02:05,379 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-24 13:02:05,379 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-24 13:02:05,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=51a41e96946b38614e7e42e54cf5ee9f, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9480933da6470a233a0ca1eb653a0f4b, ASSIGN}] 2023-09-24 13:02:05,382 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=51a41e96946b38614e7e42e54cf5ee9f, ASSIGN 2023-09-24 13:02:05,382 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9480933da6470a233a0ca1eb653a0f4b, ASSIGN 2023-09-24 13:02:05,383 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9480933da6470a233a0ca1eb653a0f4b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35765,1695560427316; forceNewPlan=false, retain=false 2023-09-24 13:02:05,383 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=51a41e96946b38614e7e42e54cf5ee9f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40801,1695560427220; forceNewPlan=false, retain=false 2023-09-24 13:02:05,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-24 13:02:05,533 INFO [jenkins-hbase4:39481] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-24 13:02:05,536 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=51a41e96946b38614e7e42e54cf5ee9f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:05,536 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9480933da6470a233a0ca1eb653a0f4b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:05,536 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695560525536"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560525536"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560525536"}]},"ts":"1695560525536"} 2023-09-24 13:02:05,536 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695560525536"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560525536"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560525536"}]},"ts":"1695560525536"} 2023-09-24 13:02:05,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 51a41e96946b38614e7e42e54cf5ee9f, server=jenkins-hbase4.apache.org,40801,1695560427220}] 2023-09-24 13:02:05,538 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 9480933da6470a233a0ca1eb653a0f4b, server=jenkins-hbase4.apache.org,35765,1695560427316}] 2023-09-24 13:02:05,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-24 13:02:05,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. 2023-09-24 13:02:05,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9480933da6470a233a0ca1eb653a0f4b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b.', STARTKEY => '1', ENDKEY => ''} 2023-09-24 13:02:05,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:05,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 51a41e96946b38614e7e42e54cf5ee9f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f.', STARTKEY => '', ENDKEY => '1'} 2023-09-24 13:02:05,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. service=AccessControlService 2023-09-24 13:02:05,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:02:05,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. service=AccessControlService 2023-09-24 13:02:05,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 9480933da6470a233a0ca1eb653a0f4b 2023-09-24 13:02:05,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:02:05,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-24 13:02:05,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9480933da6470a233a0ca1eb653a0f4b 2023-09-24 13:02:05,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9480933da6470a233a0ca1eb653a0f4b 2023-09-24 13:02:05,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 51a41e96946b38614e7e42e54cf5ee9f 2023-09-24 13:02:05,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-24 13:02:05,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 51a41e96946b38614e7e42e54cf5ee9f 2023-09-24 13:02:05,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 51a41e96946b38614e7e42e54cf5ee9f 2023-09-24 13:02:05,694 INFO [StoreOpener-9480933da6470a233a0ca1eb653a0f4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9480933da6470a233a0ca1eb653a0f4b 2023-09-24 13:02:05,694 INFO [StoreOpener-51a41e96946b38614e7e42e54cf5ee9f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 51a41e96946b38614e7e42e54cf5ee9f 2023-09-24 13:02:05,695 DEBUG [StoreOpener-9480933da6470a233a0ca1eb653a0f4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b/cf 2023-09-24 13:02:05,695 DEBUG [StoreOpener-51a41e96946b38614e7e42e54cf5ee9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f/cf 2023-09-24 13:02:05,695 DEBUG [StoreOpener-51a41e96946b38614e7e42e54cf5ee9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f/cf 2023-09-24 13:02:05,695 DEBUG [StoreOpener-9480933da6470a233a0ca1eb653a0f4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b/cf 2023-09-24 13:02:05,696 INFO [StoreOpener-9480933da6470a233a0ca1eb653a0f4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9480933da6470a233a0ca1eb653a0f4b columnFamilyName cf 2023-09-24 13:02:05,696 INFO [StoreOpener-51a41e96946b38614e7e42e54cf5ee9f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 51a41e96946b38614e7e42e54cf5ee9f columnFamilyName cf 2023-09-24 13:02:05,697 INFO [StoreOpener-51a41e96946b38614e7e42e54cf5ee9f-1] regionserver.HStore(310): Store=51a41e96946b38614e7e42e54cf5ee9f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:02:05,697 INFO [StoreOpener-9480933da6470a233a0ca1eb653a0f4b-1] regionserver.HStore(310): Store=9480933da6470a233a0ca1eb653a0f4b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-24 13:02:05,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f 2023-09-24 13:02:05,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b 2023-09-24 13:02:05,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f 2023-09-24 13:02:05,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b 2023-09-24 13:02:05,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9480933da6470a233a0ca1eb653a0f4b 2023-09-24 13:02:05,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 51a41e96946b38614e7e42e54cf5ee9f 2023-09-24 13:02:05,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:02:05,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-24 13:02:05,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9480933da6470a233a0ca1eb653a0f4b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60141980, jitterRate=-0.10381466150283813}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:02:05,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 51a41e96946b38614e7e42e54cf5ee9f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65631505, jitterRate=-0.02201436460018158}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-24 13:02:05,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9480933da6470a233a0ca1eb653a0f4b: 2023-09-24 13:02:05,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 51a41e96946b38614e7e42e54cf5ee9f: 2023-09-24 13:02:05,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b., pid=109, masterSystemTime=1695560525689 2023-09-24 13:02:05,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f., pid=108, masterSystemTime=1695560525689 2023-09-24 13:02:05,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. 2023-09-24 13:02:05,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. 2023-09-24 13:02:05,706 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9480933da6470a233a0ca1eb653a0f4b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:05,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:05,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:05,707 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695560525706"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560525706"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560525706"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560525706"}]},"ts":"1695560525706"} 2023-09-24 13:02:05,707 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=51a41e96946b38614e7e42e54cf5ee9f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:05,707 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695560525707"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695560525707"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695560525707"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695560525707"}]},"ts":"1695560525707"} 2023-09-24 13:02:05,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-24 13:02:05,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 9480933da6470a233a0ca1eb653a0f4b, server=jenkins-hbase4.apache.org,35765,1695560427316 in 170 msec 2023-09-24 13:02:05,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-24 13:02:05,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 51a41e96946b38614e7e42e54cf5ee9f, server=jenkins-hbase4.apache.org,40801,1695560427220 in 172 msec 2023-09-24 13:02:05,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9480933da6470a233a0ca1eb653a0f4b, ASSIGN in 330 msec 2023-09-24 13:02:05,712 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-24 13:02:05,712 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=51a41e96946b38614e7e42e54cf5ee9f, ASSIGN in 331 msec 2023-09-24 13:02:05,713 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-24 13:02:05,713 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560525713"}]},"ts":"1695560525713"} 2023-09-24 13:02:05,714 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-24 13:02:05,716 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-24 13:02:05,716 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-24 13:02:05,718 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35765] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-24 13:02:05,719 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:02:05,719 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:02:05,719 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:02:05,719 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:02:05,720 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-24 13:02:05,720 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-24 13:02:05,720 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-24 13:02:05,721 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-24 13:02:05,721 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 388 msec 2023-09-24 13:02:05,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-24 13:02:05,938 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-24 13:02:05,940 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:05,940 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:05,943 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 13:02:05,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 13:02:05,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695560525954 (current time:1695560525954). 2023-09-24 13:02:05,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 13:02:05,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x0e2be83b to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:02:05,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@318a4e70, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:02:05,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:02:05,965 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:02:05,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e2be83b to 127.0.0.1:55856 2023-09-24 13:02:05,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:02:05,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x01c36fc2 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:02:05,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50f825f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:02:05,973 DEBUG [hconnection-0x33620850-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:02:05,975 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:02:05,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:02:05,981 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:02:05,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01c36fc2 to 127.0.0.1:55856 2023-09-24 13:02:05,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:02:05,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-24 13:02:05,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 13:02:05,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 13:02:05,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 13:02:05,985 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 13:02:05,986 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695561125986 2023-09-24 13:02:05,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 13:02:05,986 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:05,987 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 13:02:05,987 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 13:02:05,988 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 13:02:05,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 13:02:05,989 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-24 13:02:05,990 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 13:02:05,990 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695561125990 2023-09-24 13:02:05,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:05,998 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-24 13:02:05,998 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:02:05,999 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-24 13:02:05,999 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-24 13:02:05,999 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:05,999 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,002 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:02:06,002 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,002 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:02:06,002 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:02:06,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:02:06,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:02:06,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:02:06,002 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:02:06,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:02:06,002 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:02:06,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,002 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,003 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 13:02:06,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-24 13:02:06,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-24 13:02:06,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,003 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 13:02:06,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-24 13:02:06,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,003 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 13:02:06,003 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 13:02:06,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,004 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,004 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 13:02:06,004 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 13:02:06,004 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:02:06,004 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:02:06,004 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,005 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 13:02:06,005 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 13:02:06,005 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 13:02:06,006 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 13:02:06,005 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 13:02:06,006 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:02:06,006 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 13:02:06,006 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 13:02:06,006 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 13:02:06,006 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 13:02:06,006 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 13:02:06,013 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,013 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:02:06,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:02:06,013 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,013 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:02:06,013 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,013 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,014 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:02:06,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:02:06,014 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,014 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:02:06,014 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,014 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:02:06,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:02:06,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-24 13:02:06,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18fbe746[Count = 1] remaining members to acquire global barrier 2023-09-24 13:02:06,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:02:06,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:02:06,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:02:06,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:02:06,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:02:06,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-24 13:02:06,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18fbe746[Count = 0] remaining members to acquire global barrier 2023-09-24 13:02:06,017 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-24 13:02:06,017 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,018 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,018 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,018 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,019 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 13:02:06,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,019 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 13:02:06,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,019 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,019 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 13:02:06,019 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 13:02:06,019 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44885,1695560427276' in zk 2023-09-24 13:02:06,019 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,019 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 13:02:06,019 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:02:06,019 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:02:06,019 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:02:06,019 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:02:06,019 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:06,019 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. 2023-09-24 13:02:06,019 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. started... 2023-09-24 13:02:06,019 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. started... 2023-09-24 13:02:06,020 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 51a41e96946b38614e7e42e54cf5ee9f: 2023-09-24 13:02:06,021 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9480933da6470a233a0ca1eb653a0f4b: 2023-09-24 13:02:06,021 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 13:02:06,021 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,021 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,021 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:02:06,021 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:02:06,021 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:02:06,022 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 13:02:06,021 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 13:02:06,022 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-24 13:02:06,033 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. completed. 2023-09-24 13:02:06,033 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:06,034 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:02:06,034 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:02:06,034 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,034 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 13:02:06,034 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40801,1695560427220' in zk 2023-09-24 13:02:06,034 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. completed. 2023-09-24 13:02:06,034 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. 2023-09-24 13:02:06,034 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:02:06,034 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:02:06,034 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,034 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 13:02:06,034 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35765,1695560427316' in zk 2023-09-24 13:02:06,036 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 13:02:06,036 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,036 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:02:06,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,036 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 13:02:06,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:02:06,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:02:06,038 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 13:02:06,038 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,038 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:02:06,038 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 13:02:06,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:02:06,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:02:06,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:02:06,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40801,1695560427220': 2023-09-24 13:02:06,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-24 13:02:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:02:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:02:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:02:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:02:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:02:06,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35765,1695560427316': 2023-09-24 13:02:06,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-24 13:02:06,045 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-24 13:02:06,045 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 13:02:06,045 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 13:02:06,045 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,045 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 13:02:06,046 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,046 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,046 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:02:06,046 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,046 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:02:06,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:02:06,046 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:02:06,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,046 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:02:06,047 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:02:06,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:02:06,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:02:06,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:02:06,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:02:06,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:02:06,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:02:06,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,047 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,048 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:02:06,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,049 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:02:06,049 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,050 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,052 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,052 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:02:06,052 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:02:06,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:02:06,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:02:06,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:02:06,052 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:02:06,052 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:02:06,052 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:02:06,052 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,052 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:02:06,052 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:02:06,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:02:06,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:02:06,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:02:06,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:02:06,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:02:06,052 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:02:06,052 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:02:06,052 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 13:02:06,054 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:02:06,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:02:06,054 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,054 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,054 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,055 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,055 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,055 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,055 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-24 13:02:06,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,087 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:02:06,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-24 13:02:06,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-24 13:02:06,088 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 13:02:06,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,089 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-24 13:02:06,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,090 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695560525986Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695560526063 (+77 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695560526063Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695560526063Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695560526070 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695560526081 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695560526089 (+8 ms) 2023-09-24 13:02:06,093 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 13:02:06,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 106 msec 2023-09-24 13:02:06,288 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:02:06,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-24 13:02:06,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 13:02:06,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40801] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 13:02:06,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35765] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-24 13:02:06,295 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,295 DEBUG [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:06,295 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-24 13:02:06,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 13:02:06,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695560526304 (current time:1695560526304). 2023-09-24 13:02:06,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-24 13:02:06,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x11f0c64e to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:02:06,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32737ca8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:02:06,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:02:06,313 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:02:06,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11f0c64e to 127.0.0.1:55856 2023-09-24 13:02:06,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:02:06,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(139): Connect 0x16ff7f53 to 127.0.0.1:55856 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-24 13:02:06,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12a1974, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-24 13:02:06,321 DEBUG [hconnection-0x2815a3c5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:02:06,324 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:02:06,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-24 13:02:06,334 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-24 13:02:06,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16ff7f53 to 127.0.0.1:55856 2023-09-24 13:02:06,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:02:06,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-24 13:02:06,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-24 13:02:06,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 13:02:06,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 13:02:06,339 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 13:02:06,339 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695561126339 2023-09-24 13:02:06,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-24 13:02:06,339 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,341 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-24 13:02:06,341 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-24 13:02:06,342 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-24 13:02:06,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 13:02:06,342 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-24 13:02:06,343 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 13:02:06,344 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695561126344 2023-09-24 13:02:06,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,359 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-24 13:02:06,359 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:02:06,361 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-24 13:02:06,361 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-24 13:02:06,362 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,362 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,364 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:02:06,364 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:02:06,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:02:06,364 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:02:06,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:02:06,364 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:02:06,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:02:06,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:02:06,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:02:06,364 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,364 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,365 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,365 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-24 13:02:06,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-24 13:02:06,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-24 13:02:06,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-24 13:02:06,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,366 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 13:02:06,366 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 13:02:06,366 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-24 13:02:06,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,366 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 13:02:06,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,366 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 13:02:06,366 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:02:06,366 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:02:06,368 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 13:02:06,368 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 13:02:06,369 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44885,1695560427276' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 13:02:06,366 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-24 13:02:06,369 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 13:02:06,369 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 13:02:06,369 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-24 13:02:06,369 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 13:02:06,370 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-24 13:02:06,370 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-24 13:02:06,370 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-24 13:02:06,372 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,373 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,373 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,373 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,373 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:02:06,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:02:06,373 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,373 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,373 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:02:06,373 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:02:06,373 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,373 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-24 13:02:06,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:02:06,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:02:06,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:02:06,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40801,1695560427220' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-24 13:02:06,375 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d9b6eaa[Count = 1] remaining members to acquire global barrier 2023-09-24 13:02:06,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:02:06,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:02:06,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:02:06,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:02:06,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:02:06,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35765,1695560427316' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-24 13:02:06,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d9b6eaa[Count = 0] remaining members to acquire global barrier 2023-09-24 13:02:06,378 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-24 13:02:06,378 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,382 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,382 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,382 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,382 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,382 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 13:02:06,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,383 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 13:02:06,383 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,383 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-24 13:02:06,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,383 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:02:06,383 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:02:06,383 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 13:02:06,383 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-24 13:02:06,383 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:06,383 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,44885,1695560427276' in zk 2023-09-24 13:02:06,383 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. started... 2023-09-24 13:02:06,383 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. 2023-09-24 13:02:06,383 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-24 13:02:06,383 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-24 13:02:06,383 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. started... 2023-09-24 13:02:06,383 INFO [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 51a41e96946b38614e7e42e54cf5ee9f 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-24 13:02:06,384 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9480933da6470a233a0ca1eb653a0f4b 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-24 13:02:06,385 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 13:02:06,385 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:02:06,385 DEBUG [member: 'jenkins-hbase4.apache.org,44885,1695560427276' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 13:02:06,414 INFO [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230924b889bbe9f36e40c1b368b042a1ac5df5 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230924b889bbe9f36e40c1b368b042a1ac5df5 2023-09-24 13:02:06,419 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309248ad6dd270707480ea25de77ad7eabc1b to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309248ad6dd270707480ea25de77ad7eabc1b 2023-09-24 13:02:06,432 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b/.tmp/cf/e984b47c971d4cf5a688e417e7043c45 2023-09-24 13:02:06,432 INFO [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f/.tmp/cf/9c5167cd9acf49f3a23d04f378c941f3 2023-09-24 13:02:06,437 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b/.tmp/cf/e984b47c971d4cf5a688e417e7043c45 as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b/cf/e984b47c971d4cf5a688e417e7043c45 2023-09-24 13:02:06,437 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f/.tmp/cf/9c5167cd9acf49f3a23d04f378c941f3 as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f/cf/9c5167cd9acf49f3a23d04f378c941f3 2023-09-24 13:02:06,441 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:02:06,442 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b/cf/e984b47c971d4cf5a688e417e7043c45, entries=47, sequenceid=6, filesize=13.3 K 2023-09-24 13:02:06,442 INFO [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f/cf/9c5167cd9acf49f3a23d04f378c941f3, entries=3, sequenceid=6, filesize=5.4 K 2023-09-24 13:02:06,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-24 13:02:06,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-24 13:02:06,442 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-24 13:02:06,443 INFO [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 9480933da6470a233a0ca1eb653a0f4b in 59ms, sequenceid=6, compaction requested=false 2023-09-24 13:02:06,442 INFO [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 51a41e96946b38614e7e42e54cf5ee9f in 59ms, sequenceid=6, compaction requested=false 2023-09-24 13:02:06,443 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-24 13:02:06,443 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-24 13:02:06,447 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9480933da6470a233a0ca1eb653a0f4b: 2023-09-24 13:02:06,447 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 51a41e96946b38614e7e42e54cf5ee9f: 2023-09-24 13:02:06,447 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,447 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,447 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:02:06,447 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-24 13:02:06,447 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b/cf/e984b47c971d4cf5a688e417e7043c45] hfiles 2023-09-24 13:02:06,447 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f/cf/9c5167cd9acf49f3a23d04f378c941f3] hfiles 2023-09-24 13:02:06,447 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f/cf/9c5167cd9acf49f3a23d04f378c941f3 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,447 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b/cf/e984b47c971d4cf5a688e417e7043c45 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,460 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. completed. 2023-09-24 13:02:06,460 DEBUG [rs(jenkins-hbase4.apache.org,40801,1695560427220)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:06,460 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. completed. 2023-09-24 13:02:06,460 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:02:06,460 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:02:06,460 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,460 DEBUG [rs(jenkins-hbase4.apache.org,35765,1695560427316)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. 2023-09-24 13:02:06,460 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 13:02:06,460 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40801,1695560427220' in zk 2023-09-24 13:02:06,460 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-24 13:02:06,460 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-24 13:02:06,460 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,460 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-24 13:02:06,460 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35765,1695560427316' in zk 2023-09-24 13:02:06,462 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 13:02:06,462 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:02:06,462 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,462 DEBUG [member: 'jenkins-hbase4.apache.org,40801,1695560427220' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 13:02:06,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:02:06,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:02:06,464 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-24 13:02:06,464 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,464 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:02:06,464 DEBUG [member: 'jenkins-hbase4.apache.org,35765,1695560427316' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-24 13:02:06,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:02:06,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:02:06,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:02:06,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40801,1695560427220': 2023-09-24 13:02:06,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40801,1695560427220' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-24 13:02:06,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:02:06,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:02:06,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:02:06,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:02:06,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:02:06,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35765,1695560427316': 2023-09-24 13:02:06,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35765,1695560427316' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-24 13:02:06,471 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-24 13:02:06,471 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-24 13:02:06,472 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-24 13:02:06,472 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,472 INFO [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-24 13:02:06,474 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,474 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,474 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,474 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:02:06,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-24 13:02:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-24 13:02:06,474 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,474 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:02:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,475 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:02:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-24 13:02:06,475 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:02:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:02:06,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:02:06,475 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:02:06,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:02:06,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:02:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,476 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-24 13:02:06,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,478 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-24 13:02:06,478 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,478 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,481 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,481 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:02:06,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:02:06,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:02:06,481 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,481 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:02:06,481 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:02:06,481 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,481 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,481 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,481 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-24 13:02:06,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:02:06,481 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:02:06,481 DEBUG [(jenkins-hbase4.apache.org,39481,1695560426000)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-24 13:02:06,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:02:06,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:02:06,481 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:02:06,481 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-24 13:02:06,481 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-24 13:02:06,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-24 13:02:06,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-24 13:02:06,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:02:06,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:02:06,483 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:06,483 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,483 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:06,483 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:06,483 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,483 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-24 13:02:06,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-24 13:02:06,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309248ad6dd270707480ea25de77ad7eabc1b, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230924b889bbe9f36e40c1b368b042a1ac5df5] mob files 2023-09-24 13:02:06,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309248ad6dd270707480ea25de77ad7eabc1b 2023-09-24 13:02:06,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230924b889bbe9f36e40c1b368b042a1ac5df5 2023-09-24 13:02:06,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,492 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,511 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-24 13:02:06,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,512 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695560526339Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695560526491 (+152 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695560526491Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695560526491Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695560526494 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695560526505 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695560526511 (+6 ms) 2023-09-24 13:02:06,515 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-24 13:02:06,517 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 175 msec 2023-09-24 13:02:06,643 DEBUG [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-24 13:02:06,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-24 13:02:06,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-24 13:02:06,644 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560526644 2023-09-24 13:02:06,644 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36659, tgtDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560526644, rawTgtDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560526644, srcFsUri=hdfs://localhost:36659, srcDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:02:06,674 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36659, inputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68 2023-09-24 13:02:06,675 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_925880282_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560526644, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560526644/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,675 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36659, inputRoot=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68, snapshotDir=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-24 13:02:06,687 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560526644/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:06,703 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-24 13:02:06,703 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-24 13:02:06,703 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-24 13:02:06,704 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-24 13:02:07,571 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop-636978461418398450.jar 2023-09-24 13:02:07,572 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-24 13:02:07,572 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-24 13:02:07,637 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/hadoop-9023270185744154885.jar 2023-09-24 13:02:07,638 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-24 13:02:07,638 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-24 13:02:07,639 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-24 13:02:07,639 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-24 13:02:07,639 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-24 13:02:07,639 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-24 13:02:07,640 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-24 13:02:07,640 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-24 13:02:07,641 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-24 13:02:07,641 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-24 13:02:07,641 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-24 13:02:07,642 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-24 13:02:07,642 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-24 13:02:07,642 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-24 13:02:07,642 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-24 13:02:07,643 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-24 13:02:07,643 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:02:07,644 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:02:07,644 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:02:07,645 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:02:07,645 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-24 13:02:07,645 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:02:07,646 DEBUG [Listener at jenkins-hbase4.apache.org/34119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-24 13:02:07,961 WARN [Listener at jenkins-hbase4.apache.org/34119] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-24 13:02:07,962 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-24 13:02:07,964 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-24 13:02:09,668 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 13:02:09,668 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-24 13:02:09,671 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0006_000001 (auth:SIMPLE) 2023-09-24 13:02:09,845 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0007_000001 (auth:SIMPLE) 2023-09-24 13:02:10,616 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 13:02:13,624 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0007_000001 (auth:SIMPLE) 2023-09-24 13:02:15,834 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0007_000001 (auth:SIMPLE) 2023-09-24 13:02:18,966 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695560433631_0007_000001 (auth:SIMPLE) 2023-09-24 13:02:20,130 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-24 13:02:20,130 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-24 13:02:20,140 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,140 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-24 13:02:20,141 INFO [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-24 13:02:20,141 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1579157240_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,141 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-24 13:02:20,141 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-24 13:02:20,141 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1579157240_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560526644/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560526644/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,142 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560526644/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-24 13:02:20,142 DEBUG [Listener at jenkins-hbase4.apache.org/34119] snapshot.TestExportSnapshot(367): hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/export-test/export-1695560526644/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-24 13:02:20,148 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-24 13:02:20,152 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560540152"}]},"ts":"1695560540152"} 2023-09-24 13:02:20,153 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-24 13:02:20,154 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-24 13:02:20,155 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=51a41e96946b38614e7e42e54cf5ee9f, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9480933da6470a233a0ca1eb653a0f4b, UNASSIGN}] 2023-09-24 13:02:20,157 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=51a41e96946b38614e7e42e54cf5ee9f, UNASSIGN 2023-09-24 13:02:20,158 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9480933da6470a233a0ca1eb653a0f4b, UNASSIGN 2023-09-24 13:02:20,159 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=51a41e96946b38614e7e42e54cf5ee9f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:20,159 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9480933da6470a233a0ca1eb653a0f4b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:20,159 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695560540159"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560540159"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560540159"}]},"ts":"1695560540159"} 2023-09-24 13:02:20,159 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695560540159"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695560540159"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695560540159"}]},"ts":"1695560540159"} 2023-09-24 13:02:20,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 51a41e96946b38614e7e42e54cf5ee9f, server=jenkins-hbase4.apache.org,40801,1695560427220}] 2023-09-24 13:02:20,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 9480933da6470a233a0ca1eb653a0f4b, server=jenkins-hbase4.apache.org,35765,1695560427316}] 2023-09-24 13:02:20,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-24 13:02:20,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 51a41e96946b38614e7e42e54cf5ee9f 2023-09-24 13:02:20,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9480933da6470a233a0ca1eb653a0f4b 2023-09-24 13:02:20,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 51a41e96946b38614e7e42e54cf5ee9f, disabling compactions & flushes 2023-09-24 13:02:20,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9480933da6470a233a0ca1eb653a0f4b, disabling compactions & flushes 2023-09-24 13:02:20,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:20,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. 2023-09-24 13:02:20,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:20,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. 2023-09-24 13:02:20,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. after waiting 0 ms 2023-09-24 13:02:20,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:20,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. after waiting 0 ms 2023-09-24 13:02:20,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. 2023-09-24 13:02:20,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 13:02:20,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 13:02:20,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:02:20,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:02:20,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b. 2023-09-24 13:02:20,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f. 2023-09-24 13:02:20,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9480933da6470a233a0ca1eb653a0f4b: 2023-09-24 13:02:20,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 51a41e96946b38614e7e42e54cf5ee9f: 2023-09-24 13:02:20,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9480933da6470a233a0ca1eb653a0f4b 2023-09-24 13:02:20,327 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9480933da6470a233a0ca1eb653a0f4b, regionState=CLOSED 2023-09-24 13:02:20,327 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695560540327"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560540327"}]},"ts":"1695560540327"} 2023-09-24 13:02:20,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 51a41e96946b38614e7e42e54cf5ee9f 2023-09-24 13:02:20,327 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=51a41e96946b38614e7e42e54cf5ee9f, regionState=CLOSED 2023-09-24 13:02:20,327 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695560540327"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695560540327"}]},"ts":"1695560540327"} 2023-09-24 13:02:20,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-24 13:02:20,330 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 9480933da6470a233a0ca1eb653a0f4b, server=jenkins-hbase4.apache.org,35765,1695560427316 in 167 msec 2023-09-24 13:02:20,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-24 13:02:20,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 51a41e96946b38614e7e42e54cf5ee9f, server=jenkins-hbase4.apache.org,40801,1695560427220 in 169 msec 2023-09-24 13:02:20,331 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9480933da6470a233a0ca1eb653a0f4b, UNASSIGN in 175 msec 2023-09-24 13:02:20,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-24 13:02:20,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=51a41e96946b38614e7e42e54cf5ee9f, UNASSIGN in 175 msec 2023-09-24 13:02:20,332 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695560540332"}]},"ts":"1695560540332"} 2023-09-24 13:02:20,333 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-24 13:02:20,334 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-24 13:02:20,336 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 187 msec 2023-09-24 13:02:20,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-24 13:02:20,454 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-24 13:02:20,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,457 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,458 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,459 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35765] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,462 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,462 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,462 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,462 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f 2023-09-24 13:02:20,462 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,462 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b 2023-09-24 13:02:20,462 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-24 13:02:20,463 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-24 13:02:20,463 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-24 13:02:20,463 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-24 13:02:20,464 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,464 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:02:20,464 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,464 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,464 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:02:20,464 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,464 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:02:20,464 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-24 13:02:20,464 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f/cf, FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f/recovered.edits] 2023-09-24 13:02:20,465 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b/cf, FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b/recovered.edits] 2023-09-24 13:02:20,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-24 13:02:20,468 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f/cf/9c5167cd9acf49f3a23d04f378c941f3 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f/cf/9c5167cd9acf49f3a23d04f378c941f3 2023-09-24 13:02:20,468 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b/cf/e984b47c971d4cf5a688e417e7043c45 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b/cf/e984b47c971d4cf5a688e417e7043c45 2023-09-24 13:02:20,471 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f/recovered.edits/9.seqid to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f/recovered.edits/9.seqid 2023-09-24 13:02:20,472 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b/recovered.edits/9.seqid to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b/recovered.edits/9.seqid 2023-09-24 13:02:20,472 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/51a41e96946b38614e7e42e54cf5ee9f 2023-09-24 13:02:20,472 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9480933da6470a233a0ca1eb653a0f4b 2023-09-24 13:02:20,472 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-24 13:02:20,473 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-24 13:02:20,473 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-24 13:02:20,477 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309248ad6dd270707480ea25de77ad7eabc1b to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309248ad6dd270707480ea25de77ad7eabc1b 2023-09-24 13:02:20,478 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230924b889bbe9f36e40c1b368b042a1ac5df5 to hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230924b889bbe9f36e40c1b368b042a1ac5df5 2023-09-24 13:02:20,478 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-24 13:02:20,481 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,483 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-24 13:02:20,485 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-24 13:02:20,486 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,486 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-24 13:02:20,486 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695560540486"}]},"ts":"9223372036854775807"} 2023-09-24 13:02:20,486 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695560540486"}]},"ts":"9223372036854775807"} 2023-09-24 13:02:20,488 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-24 13:02:20,488 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 51a41e96946b38614e7e42e54cf5ee9f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695560525331.51a41e96946b38614e7e42e54cf5ee9f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9480933da6470a233a0ca1eb653a0f4b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695560525331.9480933da6470a233a0ca1eb653a0f4b.', STARTKEY => '1', ENDKEY => ''}] 2023-09-24 13:02:20,488 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-24 13:02:20,488 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695560540488"}]},"ts":"9223372036854775807"} 2023-09-24 13:02:20,489 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-24 13:02:20,491 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,492 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 37 msec 2023-09-24 13:02:20,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-24 13:02:20,566 INFO [Listener at jenkins-hbase4.apache.org/34119] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-24 13:02:20,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-24 13:02:20,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-24 13:02:20,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39481] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-24 13:02:20,602 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 766) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1634725684_1 at /127.0.0.1:44820 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1579157240_17 at /127.0.0.1:35904 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1579157240_17 at /127.0.0.1:44840 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1579157240_17 at /127.0.0.1:54264 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ab56501-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2038956992) connection to jenkins-hbase4.apache.org/172.31.14.131:38075 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1634725684_1 at /127.0.0.1:35882 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5219 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 928), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=164 (was 141) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=7097 (was 7211) 2023-09-24 13:02:20,602 WARN [Listener at jenkins-hbase4.apache.org/34119] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-24 13:02:20,602 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-24 13:02:20,612 INFO [Listener at jenkins-hbase4.apache.org/34119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-24 13:02:20,723 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695560433631_0007_01_000001 is : 143 2023-09-24 13:02:25,892 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-24 13:02:34,737 INFO [Listener at jenkins-hbase4.apache.org/34119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-24 13:02:48,856 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-24 13:02:48,856 INFO [Listener at jenkins-hbase4.apache.org/34119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-24 13:02:48,967 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-24 13:02:48,978 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-24 13:02:48,979 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-24 13:02:48,988 INFO [Listener at jenkins-hbase4.apache.org/34119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-24 13:02:49,091 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-24 13:02:49,092 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-24 13:02:49,092 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-24 13:02:49,092 INFO [Listener at jenkins-hbase4.apache.org/34119] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-24 13:02:49,092 DEBUG [Listener at jenkins-hbase4.apache.org/34119] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52492d35 to 127.0.0.1:55856 2023-09-24 13:02:49,092 DEBUG [Listener at jenkins-hbase4.apache.org/34119] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:02:49,092 DEBUG [Listener at jenkins-hbase4.apache.org/34119] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-24 13:02:49,092 DEBUG [Listener at jenkins-hbase4.apache.org/34119] util.JVMClusterUtil(257): Found active master hash=533334150, stopped=false 2023-09-24 13:02:49,092 DEBUG [Listener at jenkins-hbase4.apache.org/34119] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:02:49,093 DEBUG [Listener at jenkins-hbase4.apache.org/34119] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-24 13:02:49,093 INFO [Listener at jenkins-hbase4.apache.org/34119] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39481,1695560426000 2023-09-24 13:02:49,094 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-24 13:02:49,094 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-24 13:02:49,094 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-24 13:02:49,094 INFO [Listener at jenkins-hbase4.apache.org/34119] procedure2.ProcedureExecutor(628): Stopping 2023-09-24 13:02:49,094 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 13:02:49,094 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-24 13:02:49,094 DEBUG [Listener at jenkins-hbase4.apache.org/34119] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x080c2d4e to 127.0.0.1:55856 2023-09-24 13:02:49,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 13:02:49,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 13:02:49,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 13:02:49,094 DEBUG [Listener at jenkins-hbase4.apache.org/34119] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:02:49,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-24 13:02:49,095 INFO [Listener at jenkins-hbase4.apache.org/34119] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40801,1695560427220' ***** 2023-09-24 13:02:49,095 DEBUG [Listener at jenkins-hbase4.apache.org/34119] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:02:49,095 INFO [Listener at jenkins-hbase4.apache.org/34119] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-24 13:02:49,095 INFO [Listener at jenkins-hbase4.apache.org/34119] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44885,1695560427276' ***** 2023-09-24 13:02:49,095 DEBUG [Listener at jenkins-hbase4.apache.org/34119] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:02:49,095 INFO [RS:0;jenkins-hbase4:40801] regionserver.HeapMemoryManager(220): Stopping 2023-09-24 13:02:49,095 INFO [Listener at jenkins-hbase4.apache.org/34119] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-24 13:02:49,096 INFO [Listener at jenkins-hbase4.apache.org/34119] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35765,1695560427316' ***** 2023-09-24 13:02:49,096 INFO [RS:0;jenkins-hbase4:40801] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-24 13:02:49,096 INFO [RS:1;jenkins-hbase4:44885] regionserver.HeapMemoryManager(220): Stopping 2023-09-24 13:02:49,096 DEBUG [Listener at jenkins-hbase4.apache.org/34119] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:02:49,096 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-24 13:02:49,096 INFO [Listener at jenkins-hbase4.apache.org/34119] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-24 13:02:49,096 INFO [RS:1;jenkins-hbase4:44885] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-24 13:02:49,096 INFO [RS:0;jenkins-hbase4:40801] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-24 13:02:49,096 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-24 13:02:49,096 INFO [RS:2;jenkins-hbase4:35765] regionserver.HeapMemoryManager(220): Stopping 2023-09-24 13:02:49,096 INFO [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:49,096 INFO [RS:2;jenkins-hbase4:35765] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-24 13:02:49,096 INFO [RS:1;jenkins-hbase4:44885] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-24 13:02:49,096 INFO [RS:2;jenkins-hbase4:35765] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-24 13:02:49,096 INFO [RS:1;jenkins-hbase4:44885] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:49,096 DEBUG [RS:1;jenkins-hbase4:44885] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e466c48 to 127.0.0.1:55856 2023-09-24 13:02:49,096 INFO [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(3305): Received CLOSE for b25ff627188d3ff231a5dedf1236ac28 2023-09-24 13:02:49,096 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-24 13:02:49,096 DEBUG [RS:0;jenkins-hbase4:40801] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x199fd150 to 127.0.0.1:55856 2023-09-24 13:02:49,096 DEBUG [RS:1;jenkins-hbase4:44885] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:02:49,097 DEBUG [RS:0;jenkins-hbase4:40801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:02:49,099 INFO [RS:1;jenkins-hbase4:44885] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44885,1695560427276; all regions closed. 2023-09-24 13:02:49,099 INFO [RS:0;jenkins-hbase4:40801] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-24 13:02:49,100 INFO [RS:0;jenkins-hbase4:40801] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-24 13:02:49,100 INFO [RS:0;jenkins-hbase4:40801] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-24 13:02:49,099 INFO [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(3305): Received CLOSE for e4362ea1fc0ab0b42473229b5f7b9e2c 2023-09-24 13:02:49,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b25ff627188d3ff231a5dedf1236ac28, disabling compactions & flushes 2023-09-24 13:02:49,100 INFO [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:49,100 INFO [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-24 13:02:49,100 DEBUG [RS:2;jenkins-hbase4:35765] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x501d889b to 127.0.0.1:55856 2023-09-24 13:02:49,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28. 2023-09-24 13:02:49,100 DEBUG [RS:2;jenkins-hbase4:35765] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:02:49,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28. 2023-09-24 13:02:49,101 INFO [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-24 13:02:49,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28. after waiting 0 ms 2023-09-24 13:02:49,101 DEBUG [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-24 13:02:49,101 INFO [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-24 13:02:49,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28. 2023-09-24 13:02:49,101 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-24 13:02:49,101 DEBUG [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(1478): Online Regions={b25ff627188d3ff231a5dedf1236ac28=hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28., e4362ea1fc0ab0b42473229b5f7b9e2c=hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c.} 2023-09-24 13:02:49,102 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-24 13:02:49,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b25ff627188d3ff231a5dedf1236ac28 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-24 13:02:49,102 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-24 13:02:49,102 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-24 13:02:49,102 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-24 13:02:49,102 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-24 13:02:49,102 DEBUG [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-24 13:02:49,102 DEBUG [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(1504): Waiting on b25ff627188d3ff231a5dedf1236ac28, e4362ea1fc0ab0b42473229b5f7b9e2c 2023-09-24 13:02:49,114 DEBUG [RS:1;jenkins-hbase4:44885] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/oldWALs 2023-09-24 13:02:49,114 INFO [RS:1;jenkins-hbase4:44885] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44885%2C1695560427276:(num 1695560428991) 2023-09-24 13:02:49,114 DEBUG [RS:1;jenkins-hbase4:44885] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:02:49,114 INFO [RS:1;jenkins-hbase4:44885] regionserver.LeaseManager(133): Closed leases 2023-09-24 13:02:49,115 INFO [RS:1;jenkins-hbase4:44885] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-24 13:02:49,115 INFO [RS:1;jenkins-hbase4:44885] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-24 13:02:49,115 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-24 13:02:49,115 INFO [RS:1;jenkins-hbase4:44885] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-24 13:02:49,115 INFO [RS:1;jenkins-hbase4:44885] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-24 13:02:49,116 INFO [RS:1;jenkins-hbase4:44885] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44885 2023-09-24 13:02:49,121 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/.tmp/info/ee794f120ea74bbc89857ceaa2d6ee2b 2023-09-24 13:02:49,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/namespace/b25ff627188d3ff231a5dedf1236ac28/.tmp/info/fa9f019aede3403283ca3087e9030aee 2023-09-24 13:02:49,123 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:49,123 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:49,123 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 13:02:49,123 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44885,1695560427276 2023-09-24 13:02:49,123 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 13:02:49,123 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 13:02:49,123 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 13:02:49,125 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44885,1695560427276] 2023-09-24 13:02:49,126 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44885,1695560427276; numProcessing=1 2023-09-24 13:02:49,128 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44885,1695560427276 already deleted, retry=false 2023-09-24 13:02:49,128 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44885,1695560427276 expired; onlineServers=2 2023-09-24 13:02:49,129 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee794f120ea74bbc89857ceaa2d6ee2b 2023-09-24 13:02:49,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/namespace/b25ff627188d3ff231a5dedf1236ac28/.tmp/info/fa9f019aede3403283ca3087e9030aee as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/namespace/b25ff627188d3ff231a5dedf1236ac28/info/fa9f019aede3403283ca3087e9030aee 2023-09-24 13:02:49,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/namespace/b25ff627188d3ff231a5dedf1236ac28/info/fa9f019aede3403283ca3087e9030aee, entries=2, sequenceid=6, filesize=4.8 K 2023-09-24 13:02:49,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for b25ff627188d3ff231a5dedf1236ac28 in 33ms, sequenceid=6, compaction requested=false 2023-09-24 13:02:49,144 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/.tmp/rep_barrier/6e5b2a394052496b8520cb5b08b44fc7 2023-09-24 13:02:49,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/namespace/b25ff627188d3ff231a5dedf1236ac28/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-24 13:02:49,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:02:49,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28. 2023-09-24 13:02:49,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b25ff627188d3ff231a5dedf1236ac28: 2023-09-24 13:02:49,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695560429392.b25ff627188d3ff231a5dedf1236ac28. 2023-09-24 13:02:49,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e4362ea1fc0ab0b42473229b5f7b9e2c, disabling compactions & flushes 2023-09-24 13:02:49,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c. 2023-09-24 13:02:49,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c. 2023-09-24 13:02:49,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c. after waiting 0 ms 2023-09-24 13:02:49,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c. 2023-09-24 13:02:49,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e4362ea1fc0ab0b42473229b5f7b9e2c 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-24 13:02:49,149 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e5b2a394052496b8520cb5b08b44fc7 2023-09-24 13:02:49,150 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-24 13:02:49,150 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-24 13:02:49,151 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-24 13:02:49,168 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/.tmp/table/f466aa29e83d4690b35131c43fbc982e 2023-09-24 13:02:49,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/acl/e4362ea1fc0ab0b42473229b5f7b9e2c/.tmp/l/876fc980a63744b19ce4e53a32c3020d 2023-09-24 13:02:49,172 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f466aa29e83d4690b35131c43fbc982e 2023-09-24 13:02:49,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 876fc980a63744b19ce4e53a32c3020d 2023-09-24 13:02:49,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/acl/e4362ea1fc0ab0b42473229b5f7b9e2c/.tmp/l/876fc980a63744b19ce4e53a32c3020d as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/acl/e4362ea1fc0ab0b42473229b5f7b9e2c/l/876fc980a63744b19ce4e53a32c3020d 2023-09-24 13:02:49,173 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/.tmp/info/ee794f120ea74bbc89857ceaa2d6ee2b as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/info/ee794f120ea74bbc89857ceaa2d6ee2b 2023-09-24 13:02:49,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 876fc980a63744b19ce4e53a32c3020d 2023-09-24 13:02:49,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/acl/e4362ea1fc0ab0b42473229b5f7b9e2c/l/876fc980a63744b19ce4e53a32c3020d, entries=7, sequenceid=18, filesize=5.2 K 2023-09-24 13:02:49,177 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ee794f120ea74bbc89857ceaa2d6ee2b 2023-09-24 13:02:49,178 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/info/ee794f120ea74bbc89857ceaa2d6ee2b, entries=48, sequenceid=131, filesize=10.3 K 2023-09-24 13:02:49,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for e4362ea1fc0ab0b42473229b5f7b9e2c in 32ms, sequenceid=18, compaction requested=false 2023-09-24 13:02:49,179 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/.tmp/rep_barrier/6e5b2a394052496b8520cb5b08b44fc7 as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/rep_barrier/6e5b2a394052496b8520cb5b08b44fc7 2023-09-24 13:02:49,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/acl/e4362ea1fc0ab0b42473229b5f7b9e2c/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-24 13:02:49,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:02:49,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c. 2023-09-24 13:02:49,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e4362ea1fc0ab0b42473229b5f7b9e2c: 2023-09-24 13:02:49,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695560430135.e4362ea1fc0ab0b42473229b5f7b9e2c. 2023-09-24 13:02:49,186 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e5b2a394052496b8520cb5b08b44fc7 2023-09-24 13:02:49,186 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/rep_barrier/6e5b2a394052496b8520cb5b08b44fc7, entries=13, sequenceid=131, filesize=6.4 K 2023-09-24 13:02:49,187 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/.tmp/table/f466aa29e83d4690b35131c43fbc982e as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/table/f466aa29e83d4690b35131c43fbc982e 2023-09-24 13:02:49,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f466aa29e83d4690b35131c43fbc982e 2023-09-24 13:02:49,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/table/f466aa29e83d4690b35131c43fbc982e, entries=24, sequenceid=131, filesize=6.9 K 2023-09-24 13:02:49,192 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 90ms, sequenceid=131, compaction requested=false 2023-09-24 13:02:49,200 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-24 13:02:49,201 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-24 13:02:49,201 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-24 13:02:49,201 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-24 13:02:49,201 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-24 13:02:49,202 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-24 13:02:49,226 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 13:02:49,226 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:44885-0x100de06161b0002, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 13:02:49,226 INFO [RS:1;jenkins-hbase4:44885] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44885,1695560427276; zookeeper connection closed. 2023-09-24 13:02:49,226 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@14baaaf7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@14baaaf7 2023-09-24 13:02:49,302 INFO [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40801,1695560427220; all regions closed. 2023-09-24 13:02:49,302 INFO [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35765,1695560427316; all regions closed. 2023-09-24 13:02:49,310 DEBUG [RS:0;jenkins-hbase4:40801] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/oldWALs 2023-09-24 13:02:49,310 DEBUG [RS:2;jenkins-hbase4:35765] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/oldWALs 2023-09-24 13:02:49,310 INFO [RS:2;jenkins-hbase4:35765] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35765%2C1695560427316:(num 1695560428991) 2023-09-24 13:02:49,310 INFO [RS:0;jenkins-hbase4:40801] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40801%2C1695560427220.meta:.meta(num 1695560429114) 2023-09-24 13:02:49,310 DEBUG [RS:2;jenkins-hbase4:35765] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:02:49,310 INFO [RS:2;jenkins-hbase4:35765] regionserver.LeaseManager(133): Closed leases 2023-09-24 13:02:49,311 INFO [RS:2;jenkins-hbase4:35765] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-24 13:02:49,311 INFO [RS:2;jenkins-hbase4:35765] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-24 13:02:49,311 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-24 13:02:49,311 INFO [RS:2;jenkins-hbase4:35765] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-24 13:02:49,311 INFO [RS:2;jenkins-hbase4:35765] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-24 13:02:49,312 INFO [RS:2;jenkins-hbase4:35765] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35765 2023-09-24 13:02:49,314 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:49,315 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35765,1695560427316 2023-09-24 13:02:49,315 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 13:02:49,316 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35765,1695560427316] 2023-09-24 13:02:49,317 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35765,1695560427316; numProcessing=2 2023-09-24 13:02:49,317 DEBUG [RS:0;jenkins-hbase4:40801] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/oldWALs 2023-09-24 13:02:49,318 INFO [RS:0;jenkins-hbase4:40801] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40801%2C1695560427220:(num 1695560428991) 2023-09-24 13:02:49,318 DEBUG [RS:0;jenkins-hbase4:40801] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:02:49,318 INFO [RS:0;jenkins-hbase4:40801] regionserver.LeaseManager(133): Closed leases 2023-09-24 13:02:49,318 INFO [RS:0;jenkins-hbase4:40801] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-24 13:02:49,318 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-24 13:02:49,319 INFO [RS:0;jenkins-hbase4:40801] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40801 2023-09-24 13:02:49,319 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35765,1695560427316 already deleted, retry=false 2023-09-24 13:02:49,319 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35765,1695560427316 expired; onlineServers=1 2023-09-24 13:02:49,320 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40801,1695560427220 2023-09-24 13:02:49,320 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-24 13:02:49,321 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40801,1695560427220] 2023-09-24 13:02:49,321 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40801,1695560427220; numProcessing=3 2023-09-24 13:02:49,322 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40801,1695560427220 already deleted, retry=false 2023-09-24 13:02:49,322 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40801,1695560427220 expired; onlineServers=0 2023-09-24 13:02:49,322 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39481,1695560426000' ***** 2023-09-24 13:02:49,322 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-24 13:02:49,323 DEBUG [M:0;jenkins-hbase4:39481] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ef702bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-24 13:02:49,323 INFO [M:0;jenkins-hbase4:39481] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39481,1695560426000 2023-09-24 13:02:49,323 INFO [M:0;jenkins-hbase4:39481] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39481,1695560426000; all regions closed. 2023-09-24 13:02:49,323 DEBUG [M:0;jenkins-hbase4:39481] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-24 13:02:49,323 DEBUG [M:0;jenkins-hbase4:39481] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-24 13:02:49,323 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-24 13:02:49,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695560428600] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695560428600,5,FailOnTimeoutGroup] 2023-09-24 13:02:49,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695560428600] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695560428600,5,FailOnTimeoutGroup] 2023-09-24 13:02:49,323 DEBUG [M:0;jenkins-hbase4:39481] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-24 13:02:49,323 INFO [M:0;jenkins-hbase4:39481] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-24 13:02:49,323 INFO [M:0;jenkins-hbase4:39481] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-24 13:02:49,323 INFO [M:0;jenkins-hbase4:39481] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-24 13:02:49,323 DEBUG [M:0;jenkins-hbase4:39481] master.HMaster(1512): Stopping service threads 2023-09-24 13:02:49,323 INFO [M:0;jenkins-hbase4:39481] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-24 13:02:49,324 ERROR [M:0;jenkins-hbase4:39481] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-24 13:02:49,324 INFO [M:0;jenkins-hbase4:39481] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-24 13:02:49,324 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-24 13:02:49,325 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-24 13:02:49,325 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-24 13:02:49,325 DEBUG [M:0;jenkins-hbase4:39481] zookeeper.ZKUtil(398): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-24 13:02:49,325 WARN [M:0;jenkins-hbase4:39481] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-24 13:02:49,325 INFO [M:0;jenkins-hbase4:39481] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-24 13:02:49,325 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-24 13:02:49,325 INFO [M:0;jenkins-hbase4:39481] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-24 13:02:49,326 DEBUG [M:0;jenkins-hbase4:39481] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-24 13:02:49,326 INFO [M:0;jenkins-hbase4:39481] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 13:02:49,326 DEBUG [M:0;jenkins-hbase4:39481] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 13:02:49,326 DEBUG [M:0;jenkins-hbase4:39481] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-24 13:02:49,326 DEBUG [M:0;jenkins-hbase4:39481] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 13:02:49,326 INFO [M:0;jenkins-hbase4:39481] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.89 KB heapSize=452.15 KB 2023-09-24 13:02:49,342 INFO [M:0;jenkins-hbase4:39481] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.89 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/285da3a31e0f4951bdce297498106105 2023-09-24 13:02:49,345 INFO [M:0;jenkins-hbase4:39481] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 285da3a31e0f4951bdce297498106105 2023-09-24 13:02:49,346 DEBUG [M:0;jenkins-hbase4:39481] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/285da3a31e0f4951bdce297498106105 as hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/285da3a31e0f4951bdce297498106105 2023-09-24 13:02:49,349 INFO [M:0;jenkins-hbase4:39481] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 285da3a31e0f4951bdce297498106105 2023-09-24 13:02:49,350 INFO [M:0;jenkins-hbase4:39481] regionserver.HStore(1080): Added hdfs://localhost:36659/user/jenkins/test-data/4a15740b-6d4a-d2c4-fb3a-6306df8d8d68/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/285da3a31e0f4951bdce297498106105, entries=119, sequenceid=899, filesize=28.7 K 2023-09-24 13:02:49,350 INFO [M:0;jenkins-hbase4:39481] regionserver.HRegion(2948): Finished flush of dataSize ~375.89 KB/384916, heapSize ~452.13 KB/462984, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 24ms, sequenceid=899, compaction requested=false 2023-09-24 13:02:49,352 INFO [M:0;jenkins-hbase4:39481] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-24 13:02:49,352 DEBUG [M:0;jenkins-hbase4:39481] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-24 13:02:49,355 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-24 13:02:49,355 INFO [M:0;jenkins-hbase4:39481] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-24 13:02:49,356 INFO [M:0;jenkins-hbase4:39481] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39481 2023-09-24 13:02:49,357 DEBUG [M:0;jenkins-hbase4:39481] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39481,1695560426000 already deleted, retry=false 2023-09-24 13:02:49,417 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 13:02:49,417 INFO [RS:2;jenkins-hbase4:35765] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35765,1695560427316; zookeeper connection closed. 2023-09-24 13:02:49,417 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:35765-0x100de06161b0003, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 13:02:49,417 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@24bb2260] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@24bb2260 2023-09-24 13:02:49,517 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 13:02:49,517 INFO [M:0;jenkins-hbase4:39481] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39481,1695560426000; zookeeper connection closed. 2023-09-24 13:02:49,517 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): master:39481-0x100de06161b0000, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 13:02:49,617 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 13:02:49,617 INFO [RS:0;jenkins-hbase4:40801] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40801,1695560427220; zookeeper connection closed. 2023-09-24 13:02:49,617 DEBUG [Listener at localhost/44849-EventThread] zookeeper.ZKWatcher(600): regionserver:40801-0x100de06161b0001, quorum=127.0.0.1:55856, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-24 13:02:49,618 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3732fe1e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3732fe1e 2023-09-24 13:02:49,618 INFO [Listener at jenkins-hbase4.apache.org/34119] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-24 13:02:49,618 WARN [Listener at jenkins-hbase4.apache.org/34119] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-24 13:02:49,621 INFO [Listener at jenkins-hbase4.apache.org/34119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-24 13:02:49,724 WARN [BP-541539684-172.31.14.131-1695560422359 heartbeating to localhost/127.0.0.1:36659] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-24 13:02:49,724 WARN [BP-541539684-172.31.14.131-1695560422359 heartbeating to localhost/127.0.0.1:36659] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-541539684-172.31.14.131-1695560422359 (Datanode Uuid 670e5384-15e1-47d8-9de0-cd48936cee08) service to localhost/127.0.0.1:36659 2023-09-24 13:02:49,726 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/cluster_ed01d86c-dd99-6983-78c4-e5333a88d982/dfs/data/data5/current/BP-541539684-172.31.14.131-1695560422359] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 13:02:49,727 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/cluster_ed01d86c-dd99-6983-78c4-e5333a88d982/dfs/data/data6/current/BP-541539684-172.31.14.131-1695560422359] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 13:02:49,728 WARN [Listener at jenkins-hbase4.apache.org/34119] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-24 13:02:49,730 INFO [Listener at jenkins-hbase4.apache.org/34119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-24 13:02:49,833 WARN [BP-541539684-172.31.14.131-1695560422359 heartbeating to localhost/127.0.0.1:36659] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-24 13:02:49,834 WARN [BP-541539684-172.31.14.131-1695560422359 heartbeating to localhost/127.0.0.1:36659] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-541539684-172.31.14.131-1695560422359 (Datanode Uuid ce33b143-fe0c-42cf-9daf-1f1127f2d273) service to localhost/127.0.0.1:36659 2023-09-24 13:02:49,834 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/cluster_ed01d86c-dd99-6983-78c4-e5333a88d982/dfs/data/data3/current/BP-541539684-172.31.14.131-1695560422359] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 13:02:49,835 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/cluster_ed01d86c-dd99-6983-78c4-e5333a88d982/dfs/data/data4/current/BP-541539684-172.31.14.131-1695560422359] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 13:02:49,836 WARN [Listener at jenkins-hbase4.apache.org/34119] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-24 13:02:49,838 INFO [Listener at jenkins-hbase4.apache.org/34119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-24 13:02:49,940 WARN [BP-541539684-172.31.14.131-1695560422359 heartbeating to localhost/127.0.0.1:36659] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-24 13:02:49,940 WARN [BP-541539684-172.31.14.131-1695560422359 heartbeating to localhost/127.0.0.1:36659] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-541539684-172.31.14.131-1695560422359 (Datanode Uuid 81b0b54f-63d1-440f-a356-81de79fb4095) service to localhost/127.0.0.1:36659 2023-09-24 13:02:49,941 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/cluster_ed01d86c-dd99-6983-78c4-e5333a88d982/dfs/data/data1/current/BP-541539684-172.31.14.131-1695560422359] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 13:02:49,941 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/98c320ad-a10b-b288-a59e-8f4ccecd7acc/cluster_ed01d86c-dd99-6983-78c4-e5333a88d982/dfs/data/data2/current/BP-541539684-172.31.14.131-1695560422359] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-24 13:02:49,965 INFO [Listener at jenkins-hbase4.apache.org/34119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-24 13:02:50,108 INFO [Listener at jenkins-hbase4.apache.org/34119] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-24 13:02:50,206 INFO [Listener at jenkins-hbase4.apache.org/34119] hbase.HBaseTestingUtility(1293): Minicluster is down