2023-10-05 07:00:00,909 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-10-05 07:00:01,125 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4 2023-10-05 07:00:01,126 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-10-05 07:00:01,126 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-10-05 07:00:01,169 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-05 07:00:01,397 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-05 07:00:01,397 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/cluster_7c69a4d7-26dc-b96d-a4e0-1faad6f9ad3a, deleteOnExit=true 2023-10-05 07:00:01,397 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-05 07:00:01,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/test.cache.data in system properties and HBase conf 2023-10-05 07:00:01,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop.tmp.dir in system properties and HBase conf 2023-10-05 07:00:01,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop.log.dir in system properties and HBase conf 2023-10-05 07:00:01,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-05 07:00:01,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-05 07:00:01,399 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-05 07:00:01,733 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-05 07:00:01,738 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-05 07:00:01,739 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-05 07:00:01,739 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-05 07:00:01,739 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 07:00:01,740 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-05 07:00:01,740 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-05 07:00:01,740 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 07:00:01,741 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 07:00:01,741 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-05 07:00:01,742 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/nfs.dump.dir in system properties and HBase conf 2023-10-05 07:00:01,742 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/java.io.tmpdir in system properties and HBase conf 2023-10-05 07:00:01,742 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 07:00:01,743 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-05 07:00:01,743 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-05 07:00:02,299 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-05 07:00:02,304 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-05 07:00:02,651 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-05 07:00:02,831 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-05 07:00:02,846 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 07:00:02,884 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 07:00:02,922 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/java.io.tmpdir/Jetty_localhost_43811_hdfs____.6u4jj1/webapp 2023-10-05 07:00:03,063 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43811 2023-10-05 07:00:03,076 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-05 07:00:03,076 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-05 07:00:03,675 WARN [Listener at localhost/41859] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 07:00:03,758 WARN [Listener at localhost/41859] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 07:00:03,779 WARN [Listener at localhost/41859] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 07:00:03,844 INFO [Listener at localhost/41859] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 07:00:03,853 INFO [Listener at localhost/41859] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/java.io.tmpdir/Jetty_localhost_36011_datanode____.230qz0/webapp 2023-10-05 07:00:03,962 INFO [Listener at localhost/41859] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36011 2023-10-05 07:00:04,433 WARN [Listener at localhost/42775] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 07:00:04,451 WARN [Listener at localhost/42775] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 07:00:04,457 WARN [Listener at localhost/42775] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 07:00:04,459 INFO [Listener at localhost/42775] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 07:00:04,468 INFO [Listener at localhost/42775] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/java.io.tmpdir/Jetty_localhost_41219_datanode____2j0w4k/webapp 2023-10-05 07:00:04,581 INFO [Listener at localhost/42775] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41219 2023-10-05 07:00:04,600 WARN [Listener at localhost/38075] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 07:00:04,652 WARN [Listener at localhost/38075] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-05 07:00:04,658 WARN [Listener at localhost/38075] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 07:00:04,659 INFO [Listener at localhost/38075] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 07:00:04,667 INFO [Listener at localhost/38075] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/java.io.tmpdir/Jetty_localhost_40027_datanode____xhcqu8/webapp 2023-10-05 07:00:04,789 INFO [Listener at localhost/38075] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40027 2023-10-05 07:00:04,805 WARN [Listener at localhost/45249] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-05 07:00:05,106 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbf21bf5d3345a3d4: Processing first storage report for DS-f659be2d-e68a-418c-a282-da99c174d6c0 from datanode 34081589-a41c-4139-8fbc-7cd6c977aca1 2023-10-05 07:00:05,109 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbf21bf5d3345a3d4: from storage DS-f659be2d-e68a-418c-a282-da99c174d6c0 node DatanodeRegistration(127.0.0.1:45479, datanodeUuid=34081589-a41c-4139-8fbc-7cd6c977aca1, infoPort=44695, infoSecurePort=0, ipcPort=45249, storageInfo=lv=-57;cid=testClusterID;nsid=540288762;c=1696489202396), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-05 07:00:05,109 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2bc48d82c2891a55: Processing first storage report for DS-4007a549-1a09-462a-a1ca-00448afca8a9 from datanode 28a7f23f-f330-48f0-b24e-933d50ddaadb 2023-10-05 07:00:05,109 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2bc48d82c2891a55: from storage DS-4007a549-1a09-462a-a1ca-00448afca8a9 node DatanodeRegistration(127.0.0.1:44049, datanodeUuid=28a7f23f-f330-48f0-b24e-933d50ddaadb, infoPort=33277, infoSecurePort=0, ipcPort=38075, storageInfo=lv=-57;cid=testClusterID;nsid=540288762;c=1696489202396), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 07:00:05,110 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x45c9a123934ae652: Processing first storage report for DS-c6ed843e-33e7-4c9b-88fc-3400503f1b14 from datanode 682edfc3-4d10-40b5-a6fe-b057e11b7677 2023-10-05 07:00:05,110 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x45c9a123934ae652: from storage DS-c6ed843e-33e7-4c9b-88fc-3400503f1b14 node DatanodeRegistration(127.0.0.1:39509, datanodeUuid=682edfc3-4d10-40b5-a6fe-b057e11b7677, infoPort=33773, infoSecurePort=0, ipcPort=42775, storageInfo=lv=-57;cid=testClusterID;nsid=540288762;c=1696489202396), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 07:00:05,110 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbf21bf5d3345a3d4: Processing first storage report for DS-4cf9b7cc-18c2-42f8-9e7f-03f52d752d33 from datanode 34081589-a41c-4139-8fbc-7cd6c977aca1 2023-10-05 07:00:05,110 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbf21bf5d3345a3d4: from storage DS-4cf9b7cc-18c2-42f8-9e7f-03f52d752d33 node DatanodeRegistration(127.0.0.1:45479, datanodeUuid=34081589-a41c-4139-8fbc-7cd6c977aca1, infoPort=44695, infoSecurePort=0, ipcPort=45249, storageInfo=lv=-57;cid=testClusterID;nsid=540288762;c=1696489202396), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 07:00:05,110 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2bc48d82c2891a55: Processing first storage report for DS-eca5c7fd-62a3-4afd-a232-3aa7e4c50138 from datanode 28a7f23f-f330-48f0-b24e-933d50ddaadb 2023-10-05 07:00:05,110 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2bc48d82c2891a55: from storage DS-eca5c7fd-62a3-4afd-a232-3aa7e4c50138 node DatanodeRegistration(127.0.0.1:44049, datanodeUuid=28a7f23f-f330-48f0-b24e-933d50ddaadb, infoPort=33277, infoSecurePort=0, ipcPort=38075, storageInfo=lv=-57;cid=testClusterID;nsid=540288762;c=1696489202396), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 07:00:05,111 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x45c9a123934ae652: Processing first storage report for DS-8483eba7-d163-4e93-ae3f-adcfb65ec2e8 from datanode 682edfc3-4d10-40b5-a6fe-b057e11b7677 2023-10-05 07:00:05,111 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x45c9a123934ae652: from storage DS-8483eba7-d163-4e93-ae3f-adcfb65ec2e8 node DatanodeRegistration(127.0.0.1:39509, datanodeUuid=682edfc3-4d10-40b5-a6fe-b057e11b7677, infoPort=33773, infoSecurePort=0, ipcPort=42775, storageInfo=lv=-57;cid=testClusterID;nsid=540288762;c=1696489202396), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-10-05 07:00:05,463 DEBUG [Listener at localhost/45249] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4 2023-10-05 07:00:05,550 INFO [Listener at localhost/45249] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/cluster_7c69a4d7-26dc-b96d-a4e0-1faad6f9ad3a/zookeeper_0, clientPort=58805, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/cluster_7c69a4d7-26dc-b96d-a4e0-1faad6f9ad3a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/cluster_7c69a4d7-26dc-b96d-a4e0-1faad6f9ad3a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-05 07:00:05,569 INFO [Listener at localhost/45249] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58805 2023-10-05 07:00:05,578 INFO [Listener at localhost/45249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 07:00:05,581 INFO [Listener at localhost/45249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 07:00:06,314 INFO [Listener at localhost/45249] util.FSUtils(471): Created version file at hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 with version=8 2023-10-05 07:00:06,314 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/hbase-staging 2023-10-05 07:00:06,717 INFO [Listener at localhost/45249] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-05 07:00:07,281 INFO [Listener at localhost/45249] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 07:00:07,315 INFO [Listener at localhost/45249] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 07:00:07,316 INFO [Listener at localhost/45249] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 07:00:07,316 INFO [Listener at localhost/45249] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 07:00:07,316 INFO [Listener at localhost/45249] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 07:00:07,316 INFO [Listener at localhost/45249] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 07:00:07,484 INFO [Listener at localhost/45249] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 07:00:07,559 DEBUG [Listener at localhost/45249] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-05 07:00:07,656 INFO [Listener at localhost/45249] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33507 2023-10-05 07:00:07,669 INFO [Listener at localhost/45249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 07:00:07,672 INFO [Listener at localhost/45249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 07:00:07,696 INFO [Listener at localhost/45249] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33507 connecting to ZooKeeper ensemble=127.0.0.1:58805 2023-10-05 07:00:07,758 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:335070x0, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 07:00:07,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33507-0x101156226bf0000 connected 2023-10-05 07:00:07,801 DEBUG [Listener at localhost/45249] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 07:00:07,802 DEBUG [Listener at localhost/45249] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 07:00:07,822 DEBUG [Listener at localhost/45249] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 07:00:07,832 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33507 2023-10-05 07:00:07,833 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33507 2023-10-05 07:00:07,833 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33507 2023-10-05 07:00:07,834 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33507 2023-10-05 07:00:07,837 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33507 2023-10-05 07:00:07,845 INFO [Listener at localhost/45249] master.HMaster(444): hbase.rootdir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0, hbase.cluster.distributed=false 2023-10-05 07:00:07,915 INFO [Listener at localhost/45249] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 07:00:07,915 INFO [Listener at localhost/45249] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 07:00:07,915 INFO [Listener at localhost/45249] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 07:00:07,915 INFO [Listener at localhost/45249] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 07:00:07,915 INFO [Listener at localhost/45249] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 07:00:07,915 INFO [Listener at localhost/45249] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 07:00:07,920 INFO [Listener at localhost/45249] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 07:00:07,923 INFO [Listener at localhost/45249] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35011 2023-10-05 07:00:07,926 INFO [Listener at localhost/45249] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 07:00:07,933 INFO [Listener at localhost/45249] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 07:00:07,934 INFO [Listener at localhost/45249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 07:00:07,936 INFO [Listener at localhost/45249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 07:00:07,939 INFO [Listener at localhost/45249] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35011 connecting to ZooKeeper ensemble=127.0.0.1:58805 2023-10-05 07:00:07,948 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:350110x0, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 07:00:07,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35011-0x101156226bf0001 connected 2023-10-05 07:00:07,950 DEBUG [Listener at localhost/45249] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 07:00:07,951 DEBUG [Listener at localhost/45249] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 07:00:07,952 DEBUG [Listener at localhost/45249] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 07:00:07,956 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35011 2023-10-05 07:00:07,957 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35011 2023-10-05 07:00:07,965 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35011 2023-10-05 07:00:07,967 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35011 2023-10-05 07:00:07,968 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35011 2023-10-05 07:00:07,987 INFO [Listener at localhost/45249] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 07:00:07,987 INFO [Listener at localhost/45249] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 07:00:07,988 INFO [Listener at localhost/45249] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 07:00:07,988 INFO [Listener at localhost/45249] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 07:00:07,989 INFO [Listener at localhost/45249] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 07:00:07,989 INFO [Listener at localhost/45249] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 07:00:07,989 INFO [Listener at localhost/45249] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 07:00:07,991 INFO [Listener at localhost/45249] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33577 2023-10-05 07:00:07,992 INFO [Listener at localhost/45249] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 07:00:07,993 INFO [Listener at localhost/45249] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 07:00:07,994 INFO [Listener at localhost/45249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 07:00:07,998 INFO [Listener at localhost/45249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 07:00:08,001 INFO [Listener at localhost/45249] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33577 connecting to ZooKeeper ensemble=127.0.0.1:58805 2023-10-05 07:00:08,005 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:335770x0, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 07:00:08,006 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33577-0x101156226bf0002 connected 2023-10-05 07:00:08,006 DEBUG [Listener at localhost/45249] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 07:00:08,007 DEBUG [Listener at localhost/45249] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 07:00:08,008 DEBUG [Listener at localhost/45249] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 07:00:08,009 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33577 2023-10-05 07:00:08,009 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33577 2023-10-05 07:00:08,013 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33577 2023-10-05 07:00:08,016 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33577 2023-10-05 07:00:08,017 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33577 2023-10-05 07:00:08,029 INFO [Listener at localhost/45249] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-10-05 07:00:08,030 INFO [Listener at localhost/45249] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 07:00:08,030 INFO [Listener at localhost/45249] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-05 07:00:08,030 INFO [Listener at localhost/45249] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-05 07:00:08,030 INFO [Listener at localhost/45249] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-05 07:00:08,030 INFO [Listener at localhost/45249] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-05 07:00:08,030 INFO [Listener at localhost/45249] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-05 07:00:08,032 INFO [Listener at localhost/45249] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39927 2023-10-05 07:00:08,032 INFO [Listener at localhost/45249] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-05 07:00:08,035 INFO [Listener at localhost/45249] mob.MobFileCache(125): MobFileCache disabled 2023-10-05 07:00:08,036 INFO [Listener at localhost/45249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 07:00:08,038 INFO [Listener at localhost/45249] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 07:00:08,039 INFO [Listener at localhost/45249] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39927 connecting to ZooKeeper ensemble=127.0.0.1:58805 2023-10-05 07:00:08,047 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:399270x0, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-05 07:00:08,048 DEBUG [Listener at localhost/45249] zookeeper.ZKUtil(164): regionserver:399270x0, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 07:00:08,048 DEBUG [Listener at localhost/45249] zookeeper.ZKUtil(164): regionserver:399270x0, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 07:00:08,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39927-0x101156226bf0003 connected 2023-10-05 07:00:08,049 DEBUG [Listener at localhost/45249] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-05 07:00:08,050 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39927 2023-10-05 07:00:08,050 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39927 2023-10-05 07:00:08,050 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39927 2023-10-05 07:00:08,058 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39927 2023-10-05 07:00:08,058 DEBUG [Listener at localhost/45249] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39927 2023-10-05 07:00:08,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33507,1696489206530 2023-10-05 07:00:08,069 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-05 07:00:08,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33507,1696489206530 2023-10-05 07:00:08,101 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 07:00:08,102 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 07:00:08,102 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 07:00:08,102 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 07:00:08,102 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-05 07:00:08,104 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-05 07:00:08,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33507,1696489206530 from backup master directory 2023-10-05 07:00:08,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-05 07:00:08,110 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33507,1696489206530 2023-10-05 07:00:08,110 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-05 07:00:08,111 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 07:00:08,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33507,1696489206530 2023-10-05 07:00:08,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-05 07:00:08,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-05 07:00:08,219 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/hbase.id with ID: 4000f511-9507-4518-b73f-bf2515a9153f 2023-10-05 07:00:08,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-05 07:00:08,275 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 07:00:08,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7ab960fd to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:08,379 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18f94492, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:08,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-05 07:00:08,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-05 07:00:08,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-05 07:00:08,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-05 07:00:08,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-05 07:00:08,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-05 07:00:08,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 07:00:08,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/MasterData/data/master/store-tmp 2023-10-05 07:00:08,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:08,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-05 07:00:08,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 07:00:08,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 07:00:08,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-05 07:00:08,515 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 07:00:08,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 07:00:08,516 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 07:00:08,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/MasterData/WALs/jenkins-hbase4.apache.org,33507,1696489206530 2023-10-05 07:00:08,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33507%2C1696489206530, suffix=, logDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/MasterData/WALs/jenkins-hbase4.apache.org,33507,1696489206530, archiveDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/MasterData/oldWALs, maxLogs=10 2023-10-05 07:00:08,617 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39509,DS-c6ed843e-33e7-4c9b-88fc-3400503f1b14,DISK] 2023-10-05 07:00:08,617 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44049,DS-4007a549-1a09-462a-a1ca-00448afca8a9,DISK] 2023-10-05 07:00:08,617 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45479,DS-f659be2d-e68a-418c-a282-da99c174d6c0,DISK] 2023-10-05 07:00:08,630 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-05 07:00:08,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/MasterData/WALs/jenkins-hbase4.apache.org,33507,1696489206530/jenkins-hbase4.apache.org%2C33507%2C1696489206530.1696489208554 2023-10-05 07:00:08,713 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39509,DS-c6ed843e-33e7-4c9b-88fc-3400503f1b14,DISK], DatanodeInfoWithStorage[127.0.0.1:45479,DS-f659be2d-e68a-418c-a282-da99c174d6c0,DISK], DatanodeInfoWithStorage[127.0.0.1:44049,DS-4007a549-1a09-462a-a1ca-00448afca8a9,DISK]] 2023-10-05 07:00:08,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-05 07:00:08,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:08,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 07:00:08,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 07:00:08,812 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-05 07:00:08,821 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-05 07:00:08,849 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-05 07:00:08,861 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:00:08,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-05 07:00:08,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-05 07:00:08,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-05 07:00:08,891 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:00:08,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73539413, jitterRate=0.09582264721393585}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:00:08,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 07:00:08,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-05 07:00:08,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-05 07:00:08,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-05 07:00:08,921 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-05 07:00:08,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-05 07:00:08,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 37 msec 2023-10-05 07:00:08,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-05 07:00:08,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-05 07:00:09,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-05 07:00:09,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-05 07:00:09,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-05 07:00:09,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-05 07:00:09,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-05 07:00:09,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-05 07:00:09,060 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 07:00:09,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-05 07:00:09,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-05 07:00:09,078 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-05 07:00:09,084 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 07:00:09,084 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 07:00:09,084 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 07:00:09,084 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-05 07:00:09,084 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 07:00:09,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33507,1696489206530, sessionid=0x101156226bf0000, setting cluster-up flag (Was=false) 2023-10-05 07:00:09,101 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 07:00:09,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-05 07:00:09,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33507,1696489206530 2023-10-05 07:00:09,118 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 07:00:09,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-05 07:00:09,124 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33507,1696489206530 2023-10-05 07:00:09,127 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp 2023-10-05 07:00:09,163 INFO [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(951): ClusterId : 4000f511-9507-4518-b73f-bf2515a9153f 2023-10-05 07:00:09,163 INFO [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(951): ClusterId : 4000f511-9507-4518-b73f-bf2515a9153f 2023-10-05 07:00:09,164 INFO [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(951): ClusterId : 4000f511-9507-4518-b73f-bf2515a9153f 2023-10-05 07:00:09,171 DEBUG [RS:1;jenkins-hbase4:33577] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 07:00:09,171 DEBUG [RS:0;jenkins-hbase4:35011] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 07:00:09,171 DEBUG [RS:2;jenkins-hbase4:39927] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-05 07:00:09,180 DEBUG [RS:1;jenkins-hbase4:33577] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 07:00:09,180 DEBUG [RS:0;jenkins-hbase4:35011] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 07:00:09,180 DEBUG [RS:2;jenkins-hbase4:39927] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-05 07:00:09,180 DEBUG [RS:0;jenkins-hbase4:35011] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 07:00:09,180 DEBUG [RS:1;jenkins-hbase4:33577] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 07:00:09,181 DEBUG [RS:2;jenkins-hbase4:39927] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-05 07:00:09,184 DEBUG [RS:0;jenkins-hbase4:35011] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 07:00:09,185 DEBUG [RS:2;jenkins-hbase4:39927] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 07:00:09,186 DEBUG [RS:1;jenkins-hbase4:33577] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-05 07:00:09,189 DEBUG [RS:2;jenkins-hbase4:39927] zookeeper.ReadOnlyZKClient(139): Connect 0x4ca6f025 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:09,197 DEBUG [RS:0;jenkins-hbase4:35011] zookeeper.ReadOnlyZKClient(139): Connect 0x7810b055 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:09,189 DEBUG [RS:1;jenkins-hbase4:33577] zookeeper.ReadOnlyZKClient(139): Connect 0x4ec81448 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:09,211 DEBUG [RS:0;jenkins-hbase4:35011] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76d75127, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:09,211 DEBUG [RS:2;jenkins-hbase4:39927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@426107c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:09,213 DEBUG [RS:0;jenkins-hbase4:35011] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72e8db25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 07:00:09,212 DEBUG [RS:1;jenkins-hbase4:33577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@400fe3e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:09,213 DEBUG [RS:2;jenkins-hbase4:39927] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@465e9b55, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 07:00:09,213 DEBUG [RS:1;jenkins-hbase4:33577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44307f38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 07:00:09,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-10-05 07:00:09,240 DEBUG [RS:2;jenkins-hbase4:39927] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:39927 2023-10-05 07:00:09,241 DEBUG [RS:1;jenkins-hbase4:33577] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33577 2023-10-05 07:00:09,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:00:09,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-10-05 07:00:09,247 INFO [RS:1;jenkins-hbase4:33577] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 07:00:09,247 INFO [RS:2;jenkins-hbase4:39927] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 07:00:09,248 INFO [RS:1;jenkins-hbase4:33577] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 07:00:09,248 INFO [RS:2;jenkins-hbase4:39927] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 07:00:09,249 DEBUG [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 07:00:09,249 DEBUG [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 07:00:09,249 DEBUG [RS:0;jenkins-hbase4:35011] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35011 2023-10-05 07:00:09,250 INFO [RS:0;jenkins-hbase4:35011] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-05 07:00:09,250 INFO [RS:1;jenkins-hbase4:33577] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:00:09,250 INFO [RS:0;jenkins-hbase4:35011] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-05 07:00:09,250 DEBUG [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 07:00:09,251 DEBUG [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-10-05 07:00:09,251 INFO [RS:0;jenkins-hbase4:35011] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:00:09,251 DEBUG [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 07:00:09,251 INFO [RS:2;jenkins-hbase4:39927] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:00:09,251 DEBUG [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(1022): About to register with Master. 2023-10-05 07:00:09,254 INFO [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33507,1696489206530 with isa=jenkins-hbase4.apache.org/172.31.14.131:35011, startcode=1696489207914 2023-10-05 07:00:09,255 INFO [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33507,1696489206530 with isa=jenkins-hbase4.apache.org/172.31.14.131:33577, startcode=1696489207986 2023-10-05 07:00:09,255 INFO [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33507,1696489206530 with isa=jenkins-hbase4.apache.org/172.31.14.131:39927, startcode=1696489208029 2023-10-05 07:00:09,273 DEBUG [RS:0;jenkins-hbase4:35011] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 07:00:09,273 DEBUG [RS:2;jenkins-hbase4:39927] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 07:00:09,273 DEBUG [RS:1;jenkins-hbase4:33577] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-05 07:00:09,347 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48657, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 07:00:09,347 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47687, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 07:00:09,347 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46339, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-10-05 07:00:09,368 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33507] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-05 07:00:09,376 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-05 07:00:09,378 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33507] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-05 07:00:09,379 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33507] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-05 07:00:09,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 07:00:09,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 07:00:09,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 07:00:09,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-10-05 07:00:09,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-10-05 07:00:09,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 07:00:09,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1696489239397 2023-10-05 07:00:09,401 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-05 07:00:09,401 DEBUG [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(2830): Master is not running yet 2023-10-05 07:00:09,401 DEBUG [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(2830): Master is not running yet 2023-10-05 07:00:09,401 WARN [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-05 07:00:09,401 DEBUG [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(2830): Master is not running yet 2023-10-05 07:00:09,401 WARN [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-05 07:00:09,401 WARN [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-05 07:00:09,402 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-05 07:00:09,403 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-05 07:00:09,407 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 07:00:09,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-05 07:00:09,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-05 07:00:09,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-05 07:00:09,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-05 07:00:09,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-05 07:00:09,423 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-05 07:00:09,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-05 07:00:09,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-05 07:00:09,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-05 07:00:09,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-05 07:00:09,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696489209435,5,FailOnTimeoutGroup] 2023-10-05 07:00:09,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696489209435,5,FailOnTimeoutGroup] 2023-10-05 07:00:09,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-05 07:00:09,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,454 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-05 07:00:09,455 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-05 07:00:09,455 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:00:09,478 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:09,480 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-05 07:00:09,483 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/info 2023-10-05 07:00:09,484 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-05 07:00:09,485 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:00:09,485 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-05 07:00:09,488 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/rep_barrier 2023-10-05 07:00:09,488 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-05 07:00:09,489 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:00:09,489 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-05 07:00:09,491 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/table 2023-10-05 07:00:09,492 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-05 07:00:09,493 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:00:09,494 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740 2023-10-05 07:00:09,495 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740 2023-10-05 07:00:09,499 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-05 07:00:09,501 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-05 07:00:09,502 INFO [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33507,1696489206530 with isa=jenkins-hbase4.apache.org/172.31.14.131:35011, startcode=1696489207914 2023-10-05 07:00:09,502 INFO [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33507,1696489206530 with isa=jenkins-hbase4.apache.org/172.31.14.131:33577, startcode=1696489207986 2023-10-05 07:00:09,502 INFO [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33507,1696489206530 with isa=jenkins-hbase4.apache.org/172.31.14.131:39927, startcode=1696489208029 2023-10-05 07:00:09,508 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:00:09,509 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66310126, jitterRate=-0.01190212368965149}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-05 07:00:09,509 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-05 07:00:09,509 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-05 07:00:09,510 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-05 07:00:09,510 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-05 07:00:09,510 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-05 07:00:09,510 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-05 07:00:09,511 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33507] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:09,512 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-05 07:00:09,512 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-05 07:00:09,519 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33507] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:09,519 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-05 07:00:09,520 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-05 07:00:09,520 DEBUG [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:00:09,520 DEBUG [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41859 2023-10-05 07:00:09,520 DEBUG [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 07:00:09,522 DEBUG [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:00:09,522 DEBUG [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41859 2023-10-05 07:00:09,522 DEBUG [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 07:00:09,522 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33507] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:09,524 DEBUG [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:00:09,524 DEBUG [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41859 2023-10-05 07:00:09,524 DEBUG [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-05 07:00:09,532 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 07:00:09,533 DEBUG [RS:0;jenkins-hbase4:35011] zookeeper.ZKUtil(162): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:09,533 DEBUG [RS:2;jenkins-hbase4:39927] zookeeper.ZKUtil(162): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:09,533 WARN [RS:0;jenkins-hbase4:35011] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 07:00:09,533 DEBUG [RS:1;jenkins-hbase4:33577] zookeeper.ZKUtil(162): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:09,534 INFO [RS:0;jenkins-hbase4:35011] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 07:00:09,534 WARN [RS:1;jenkins-hbase4:33577] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 07:00:09,534 DEBUG [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/WALs/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:09,533 WARN [RS:2;jenkins-hbase4:39927] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-05 07:00:09,535 INFO [RS:2;jenkins-hbase4:39927] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 07:00:09,535 DEBUG [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/WALs/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:09,535 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35011,1696489207914] 2023-10-05 07:00:09,535 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33577,1696489207986] 2023-10-05 07:00:09,535 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39927,1696489208029] 2023-10-05 07:00:09,534 INFO [RS:1;jenkins-hbase4:33577] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 07:00:09,536 DEBUG [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/WALs/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:09,542 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-05 07:00:09,558 DEBUG [RS:2;jenkins-hbase4:39927] zookeeper.ZKUtil(162): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:09,558 DEBUG [RS:0;jenkins-hbase4:35011] zookeeper.ZKUtil(162): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:09,558 DEBUG [RS:1;jenkins-hbase4:33577] zookeeper.ZKUtil(162): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:09,559 DEBUG [RS:2;jenkins-hbase4:39927] zookeeper.ZKUtil(162): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:09,559 DEBUG [RS:0;jenkins-hbase4:35011] zookeeper.ZKUtil(162): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:09,559 DEBUG [RS:1;jenkins-hbase4:33577] zookeeper.ZKUtil(162): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:09,559 DEBUG [RS:2;jenkins-hbase4:39927] zookeeper.ZKUtil(162): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:09,559 DEBUG [RS:0;jenkins-hbase4:35011] zookeeper.ZKUtil(162): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:09,560 DEBUG [RS:1;jenkins-hbase4:33577] zookeeper.ZKUtil(162): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:09,564 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-05 07:00:09,567 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-05 07:00:09,574 DEBUG [RS:2;jenkins-hbase4:39927] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 07:00:09,574 DEBUG [RS:0;jenkins-hbase4:35011] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 07:00:09,574 DEBUG [RS:1;jenkins-hbase4:33577] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-05 07:00:09,584 INFO [RS:2;jenkins-hbase4:39927] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 07:00:09,584 INFO [RS:0;jenkins-hbase4:35011] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 07:00:09,584 INFO [RS:1;jenkins-hbase4:33577] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-05 07:00:09,606 INFO [RS:2;jenkins-hbase4:39927] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 07:00:09,606 INFO [RS:1;jenkins-hbase4:33577] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 07:00:09,606 INFO [RS:0;jenkins-hbase4:35011] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-05 07:00:09,611 INFO [RS:0;jenkins-hbase4:35011] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 07:00:09,611 INFO [RS:1;jenkins-hbase4:33577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 07:00:09,611 INFO [RS:0;jenkins-hbase4:35011] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,611 INFO [RS:2;jenkins-hbase4:39927] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-05 07:00:09,612 INFO [RS:1;jenkins-hbase4:33577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,612 INFO [RS:2;jenkins-hbase4:39927] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,612 INFO [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 07:00:09,612 INFO [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 07:00:09,613 INFO [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-05 07:00:09,621 INFO [RS:2;jenkins-hbase4:39927] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,621 INFO [RS:1;jenkins-hbase4:33577] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,621 INFO [RS:0;jenkins-hbase4:35011] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,622 DEBUG [RS:2;jenkins-hbase4:39927] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,622 DEBUG [RS:1;jenkins-hbase4:33577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,622 DEBUG [RS:2;jenkins-hbase4:39927] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,622 DEBUG [RS:1;jenkins-hbase4:33577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,622 DEBUG [RS:2;jenkins-hbase4:39927] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,623 DEBUG [RS:1;jenkins-hbase4:33577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,623 DEBUG [RS:2;jenkins-hbase4:39927] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,623 DEBUG [RS:1;jenkins-hbase4:33577] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,623 DEBUG [RS:2;jenkins-hbase4:39927] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,623 DEBUG [RS:1;jenkins-hbase4:33577] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,623 DEBUG [RS:2;jenkins-hbase4:39927] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 07:00:09,622 DEBUG [RS:0;jenkins-hbase4:35011] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,623 DEBUG [RS:2;jenkins-hbase4:39927] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,623 DEBUG [RS:0;jenkins-hbase4:35011] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,623 DEBUG [RS:2;jenkins-hbase4:39927] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,623 DEBUG [RS:0;jenkins-hbase4:35011] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,623 DEBUG [RS:2;jenkins-hbase4:39927] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,623 DEBUG [RS:0;jenkins-hbase4:35011] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,623 DEBUG [RS:2;jenkins-hbase4:39927] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,623 DEBUG [RS:0;jenkins-hbase4:35011] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,623 DEBUG [RS:1;jenkins-hbase4:33577] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 07:00:09,624 DEBUG [RS:0;jenkins-hbase4:35011] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-10-05 07:00:09,624 DEBUG [RS:1;jenkins-hbase4:33577] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,624 DEBUG [RS:0;jenkins-hbase4:35011] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,624 DEBUG [RS:1;jenkins-hbase4:33577] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,624 DEBUG [RS:0;jenkins-hbase4:35011] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,624 DEBUG [RS:1;jenkins-hbase4:33577] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,624 DEBUG [RS:0;jenkins-hbase4:35011] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,625 DEBUG [RS:1;jenkins-hbase4:33577] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,625 DEBUG [RS:0;jenkins-hbase4:35011] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-10-05 07:00:09,625 INFO [RS:2;jenkins-hbase4:39927] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,625 INFO [RS:2;jenkins-hbase4:39927] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,625 INFO [RS:2;jenkins-hbase4:39927] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,627 INFO [RS:1;jenkins-hbase4:33577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,627 INFO [RS:1;jenkins-hbase4:33577] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,628 INFO [RS:0;jenkins-hbase4:35011] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,628 INFO [RS:1;jenkins-hbase4:33577] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,628 INFO [RS:0;jenkins-hbase4:35011] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,628 INFO [RS:0;jenkins-hbase4:35011] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,645 INFO [RS:2;jenkins-hbase4:39927] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 07:00:09,645 INFO [RS:1;jenkins-hbase4:33577] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 07:00:09,645 INFO [RS:0;jenkins-hbase4:35011] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-05 07:00:09,649 INFO [RS:2;jenkins-hbase4:39927] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39927,1696489208029-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,649 INFO [RS:1;jenkins-hbase4:33577] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33577,1696489207986-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,649 INFO [RS:0;jenkins-hbase4:35011] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35011,1696489207914-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:09,669 INFO [RS:2;jenkins-hbase4:39927] regionserver.Replication(203): jenkins-hbase4.apache.org,39927,1696489208029 started 2023-10-05 07:00:09,669 INFO [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39927,1696489208029, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39927, sessionid=0x101156226bf0003 2023-10-05 07:00:09,669 DEBUG [RS:2;jenkins-hbase4:39927] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 07:00:09,669 DEBUG [RS:2;jenkins-hbase4:39927] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:09,670 DEBUG [RS:2;jenkins-hbase4:39927] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39927,1696489208029' 2023-10-05 07:00:09,670 DEBUG [RS:2;jenkins-hbase4:39927] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 07:00:09,670 INFO [RS:1;jenkins-hbase4:33577] regionserver.Replication(203): jenkins-hbase4.apache.org,33577,1696489207986 started 2023-10-05 07:00:09,670 INFO [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33577,1696489207986, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33577, sessionid=0x101156226bf0002 2023-10-05 07:00:09,670 DEBUG [RS:1;jenkins-hbase4:33577] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 07:00:09,670 DEBUG [RS:1;jenkins-hbase4:33577] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:09,671 DEBUG [RS:1;jenkins-hbase4:33577] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33577,1696489207986' 2023-10-05 07:00:09,671 DEBUG [RS:1;jenkins-hbase4:33577] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 07:00:09,672 DEBUG [RS:2;jenkins-hbase4:39927] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 07:00:09,672 DEBUG [RS:1;jenkins-hbase4:33577] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 07:00:09,672 DEBUG [RS:2;jenkins-hbase4:39927] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 07:00:09,672 INFO [RS:0;jenkins-hbase4:35011] regionserver.Replication(203): jenkins-hbase4.apache.org,35011,1696489207914 started 2023-10-05 07:00:09,672 DEBUG [RS:2;jenkins-hbase4:39927] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 07:00:09,673 INFO [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35011,1696489207914, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35011, sessionid=0x101156226bf0001 2023-10-05 07:00:09,673 DEBUG [RS:2;jenkins-hbase4:39927] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:09,673 DEBUG [RS:0;jenkins-hbase4:35011] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-05 07:00:09,673 DEBUG [RS:0;jenkins-hbase4:35011] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:09,673 DEBUG [RS:2;jenkins-hbase4:39927] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39927,1696489208029' 2023-10-05 07:00:09,673 DEBUG [RS:2;jenkins-hbase4:39927] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:09,673 DEBUG [RS:0;jenkins-hbase4:35011] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35011,1696489207914' 2023-10-05 07:00:09,674 DEBUG [RS:0;jenkins-hbase4:35011] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-05 07:00:09,674 DEBUG [RS:1;jenkins-hbase4:33577] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 07:00:09,674 DEBUG [RS:1;jenkins-hbase4:33577] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 07:00:09,674 DEBUG [RS:2;jenkins-hbase4:39927] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:09,674 DEBUG [RS:1;jenkins-hbase4:33577] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:09,675 DEBUG [RS:1;jenkins-hbase4:33577] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33577,1696489207986' 2023-10-05 07:00:09,675 DEBUG [RS:1;jenkins-hbase4:33577] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:09,675 DEBUG [RS:0;jenkins-hbase4:35011] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-05 07:00:09,675 DEBUG [RS:1;jenkins-hbase4:33577] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:09,675 DEBUG [RS:2;jenkins-hbase4:39927] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 07:00:09,675 DEBUG [RS:0;jenkins-hbase4:35011] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-05 07:00:09,676 INFO [RS:2;jenkins-hbase4:39927] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 07:00:09,676 INFO [RS:2;jenkins-hbase4:39927] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 07:00:09,676 DEBUG [RS:0;jenkins-hbase4:35011] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-05 07:00:09,676 DEBUG [RS:1;jenkins-hbase4:33577] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 07:00:09,676 DEBUG [RS:0;jenkins-hbase4:35011] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:09,676 DEBUG [RS:0;jenkins-hbase4:35011] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35011,1696489207914' 2023-10-05 07:00:09,676 DEBUG [RS:0;jenkins-hbase4:35011] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:09,676 INFO [RS:1;jenkins-hbase4:33577] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 07:00:09,676 INFO [RS:1;jenkins-hbase4:33577] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 07:00:09,677 DEBUG [RS:0;jenkins-hbase4:35011] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:09,678 DEBUG [RS:0;jenkins-hbase4:35011] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-05 07:00:09,678 INFO [RS:0;jenkins-hbase4:35011] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-05 07:00:09,678 INFO [RS:0;jenkins-hbase4:35011] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-05 07:00:09,720 DEBUG [jenkins-hbase4:33507] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-10-05 07:00:09,725 DEBUG [jenkins-hbase4:33507] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 07:00:09,731 DEBUG [jenkins-hbase4:33507] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 07:00:09,731 DEBUG [jenkins-hbase4:33507] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 07:00:09,731 DEBUG [jenkins-hbase4:33507] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 07:00:09,731 DEBUG [jenkins-hbase4:33507] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 07:00:09,734 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35011,1696489207914, state=OPENING 2023-10-05 07:00:09,741 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-05 07:00:09,743 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 07:00:09,744 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-05 07:00:09,747 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35011,1696489207914}] 2023-10-05 07:00:09,787 INFO [RS:1;jenkins-hbase4:33577] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33577%2C1696489207986, suffix=, logDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/WALs/jenkins-hbase4.apache.org,33577,1696489207986, archiveDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/oldWALs, maxLogs=32 2023-10-05 07:00:09,788 INFO [RS:2;jenkins-hbase4:39927] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39927%2C1696489208029, suffix=, logDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/WALs/jenkins-hbase4.apache.org,39927,1696489208029, archiveDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/oldWALs, maxLogs=32 2023-10-05 07:00:09,787 INFO [RS:0;jenkins-hbase4:35011] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35011%2C1696489207914, suffix=, logDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/WALs/jenkins-hbase4.apache.org,35011,1696489207914, archiveDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/oldWALs, maxLogs=32 2023-10-05 07:00:09,815 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44049,DS-4007a549-1a09-462a-a1ca-00448afca8a9,DISK] 2023-10-05 07:00:09,816 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39509,DS-c6ed843e-33e7-4c9b-88fc-3400503f1b14,DISK] 2023-10-05 07:00:09,824 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39509,DS-c6ed843e-33e7-4c9b-88fc-3400503f1b14,DISK] 2023-10-05 07:00:09,824 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45479,DS-f659be2d-e68a-418c-a282-da99c174d6c0,DISK] 2023-10-05 07:00:09,830 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45479,DS-f659be2d-e68a-418c-a282-da99c174d6c0,DISK] 2023-10-05 07:00:09,830 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44049,DS-4007a549-1a09-462a-a1ca-00448afca8a9,DISK] 2023-10-05 07:00:09,831 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39509,DS-c6ed843e-33e7-4c9b-88fc-3400503f1b14,DISK] 2023-10-05 07:00:09,832 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44049,DS-4007a549-1a09-462a-a1ca-00448afca8a9,DISK] 2023-10-05 07:00:09,832 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45479,DS-f659be2d-e68a-418c-a282-da99c174d6c0,DISK] 2023-10-05 07:00:09,842 INFO [RS:1;jenkins-hbase4:33577] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/WALs/jenkins-hbase4.apache.org,33577,1696489207986/jenkins-hbase4.apache.org%2C33577%2C1696489207986.1696489209792 2023-10-05 07:00:09,842 INFO [RS:0;jenkins-hbase4:35011] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/WALs/jenkins-hbase4.apache.org,35011,1696489207914/jenkins-hbase4.apache.org%2C35011%2C1696489207914.1696489209792 2023-10-05 07:00:09,842 INFO [RS:2;jenkins-hbase4:39927] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/WALs/jenkins-hbase4.apache.org,39927,1696489208029/jenkins-hbase4.apache.org%2C39927%2C1696489208029.1696489209792 2023-10-05 07:00:09,843 DEBUG [RS:1;jenkins-hbase4:33577] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44049,DS-4007a549-1a09-462a-a1ca-00448afca8a9,DISK], DatanodeInfoWithStorage[127.0.0.1:39509,DS-c6ed843e-33e7-4c9b-88fc-3400503f1b14,DISK], DatanodeInfoWithStorage[127.0.0.1:45479,DS-f659be2d-e68a-418c-a282-da99c174d6c0,DISK]] 2023-10-05 07:00:09,843 DEBUG [RS:0;jenkins-hbase4:35011] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45479,DS-f659be2d-e68a-418c-a282-da99c174d6c0,DISK], DatanodeInfoWithStorage[127.0.0.1:39509,DS-c6ed843e-33e7-4c9b-88fc-3400503f1b14,DISK], DatanodeInfoWithStorage[127.0.0.1:44049,DS-4007a549-1a09-462a-a1ca-00448afca8a9,DISK]] 2023-10-05 07:00:09,843 DEBUG [RS:2;jenkins-hbase4:39927] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39509,DS-c6ed843e-33e7-4c9b-88fc-3400503f1b14,DISK], DatanodeInfoWithStorage[127.0.0.1:45479,DS-f659be2d-e68a-418c-a282-da99c174d6c0,DISK], DatanodeInfoWithStorage[127.0.0.1:44049,DS-4007a549-1a09-462a-a1ca-00448afca8a9,DISK]] 2023-10-05 07:00:09,935 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:09,938 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 07:00:09,942 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 07:00:09,961 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-05 07:00:09,962 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-05 07:00:09,968 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35011%2C1696489207914.meta, suffix=.meta, logDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/WALs/jenkins-hbase4.apache.org,35011,1696489207914, archiveDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/oldWALs, maxLogs=32 2023-10-05 07:00:09,991 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44049,DS-4007a549-1a09-462a-a1ca-00448afca8a9,DISK] 2023-10-05 07:00:09,998 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39509,DS-c6ed843e-33e7-4c9b-88fc-3400503f1b14,DISK] 2023-10-05 07:00:09,999 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45479,DS-f659be2d-e68a-418c-a282-da99c174d6c0,DISK] 2023-10-05 07:00:10,012 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/WALs/jenkins-hbase4.apache.org,35011,1696489207914/jenkins-hbase4.apache.org%2C35011%2C1696489207914.meta.1696489209970.meta 2023-10-05 07:00:10,013 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44049,DS-4007a549-1a09-462a-a1ca-00448afca8a9,DISK], DatanodeInfoWithStorage[127.0.0.1:39509,DS-c6ed843e-33e7-4c9b-88fc-3400503f1b14,DISK], DatanodeInfoWithStorage[127.0.0.1:45479,DS-f659be2d-e68a-418c-a282-da99c174d6c0,DISK]] 2023-10-05 07:00:10,014 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-05 07:00:10,015 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-10-05 07:00:10,017 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:00:10,018 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-05 07:00:10,021 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-05 07:00:10,023 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-05 07:00:10,042 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-05 07:00:10,043 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:10,043 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-05 07:00:10,043 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-05 07:00:10,046 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-05 07:00:10,048 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/info 2023-10-05 07:00:10,048 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/info 2023-10-05 07:00:10,049 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-05 07:00:10,050 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:00:10,050 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-05 07:00:10,051 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/rep_barrier 2023-10-05 07:00:10,051 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/rep_barrier 2023-10-05 07:00:10,052 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-05 07:00:10,053 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:00:10,053 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-05 07:00:10,054 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/table 2023-10-05 07:00:10,055 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/table 2023-10-05 07:00:10,055 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-05 07:00:10,056 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:00:10,058 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740 2023-10-05 07:00:10,060 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740 2023-10-05 07:00:10,064 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-05 07:00:10,067 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-05 07:00:10,069 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70914980, jitterRate=0.056715548038482666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-05 07:00:10,073 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-05 07:00:10,086 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1696489209925 2023-10-05 07:00:10,105 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-05 07:00:10,106 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-05 07:00:10,107 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35011,1696489207914, state=OPEN 2023-10-05 07:00:10,110 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-05 07:00:10,110 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-05 07:00:10,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-05 07:00:10,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35011,1696489207914 in 363 msec 2023-10-05 07:00:10,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-05 07:00:10,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 579 msec 2023-10-05 07:00:10,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 867 msec 2023-10-05 07:00:10,124 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1696489210124, completionTime=-1 2023-10-05 07:00:10,124 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-10-05 07:00:10,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-10-05 07:00:10,196 DEBUG [hconnection-0x54d69dd8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:10,199 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:10,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-10-05 07:00:10,220 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1696489270220 2023-10-05 07:00:10,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1696489330220 2023-10-05 07:00:10,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 96 msec 2023-10-05 07:00:10,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33507,1696489206530-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:10,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33507,1696489206530-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:10,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33507,1696489206530-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:10,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33507, period=300000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:10,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-05 07:00:10,255 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-05 07:00:10,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-05 07:00:10,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 07:00:10,273 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-05 07:00:10,276 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 07:00:10,280 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 07:00:10,304 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/hbase/namespace/10f773d120b025203d205e5501cc214d 2023-10-05 07:00:10,307 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/hbase/namespace/10f773d120b025203d205e5501cc214d empty. 2023-10-05 07:00:10,307 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/hbase/namespace/10f773d120b025203d205e5501cc214d 2023-10-05 07:00:10,308 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-05 07:00:10,346 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-05 07:00:10,348 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 10f773d120b025203d205e5501cc214d, NAME => 'hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp 2023-10-05 07:00:10,367 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:10,367 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 10f773d120b025203d205e5501cc214d, disabling compactions & flushes 2023-10-05 07:00:10,367 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d. 2023-10-05 07:00:10,367 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d. 2023-10-05 07:00:10,367 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d. after waiting 0 ms 2023-10-05 07:00:10,367 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d. 2023-10-05 07:00:10,367 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d. 2023-10-05 07:00:10,367 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 10f773d120b025203d205e5501cc214d: 2023-10-05 07:00:10,372 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 07:00:10,393 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696489210375"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489210375"}]},"ts":"1696489210375"} 2023-10-05 07:00:10,422 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-05 07:00:10,424 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 07:00:10,428 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489210424"}]},"ts":"1696489210424"} 2023-10-05 07:00:10,432 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-05 07:00:10,438 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 07:00:10,439 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 07:00:10,439 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 07:00:10,439 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 07:00:10,439 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 07:00:10,442 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=10f773d120b025203d205e5501cc214d, ASSIGN}] 2023-10-05 07:00:10,446 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=10f773d120b025203d205e5501cc214d, ASSIGN 2023-10-05 07:00:10,447 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=10f773d120b025203d205e5501cc214d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33577,1696489207986; forceNewPlan=false, retain=false 2023-10-05 07:00:10,599 INFO [jenkins-hbase4:33507] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 07:00:10,600 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=10f773d120b025203d205e5501cc214d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:10,601 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696489210600"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489210600"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489210600"}]},"ts":"1696489210600"} 2023-10-05 07:00:10,605 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 10f773d120b025203d205e5501cc214d, server=jenkins-hbase4.apache.org,33577,1696489207986}] 2023-10-05 07:00:10,761 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:10,762 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 07:00:10,765 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 07:00:10,771 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d. 2023-10-05 07:00:10,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 10f773d120b025203d205e5501cc214d, NAME => 'hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d.', STARTKEY => '', ENDKEY => ''} 2023-10-05 07:00:10,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d. service=AccessControlService 2023-10-05 07:00:10,772 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:00:10,772 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 10f773d120b025203d205e5501cc214d 2023-10-05 07:00:10,772 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:10,773 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 10f773d120b025203d205e5501cc214d 2023-10-05 07:00:10,773 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 10f773d120b025203d205e5501cc214d 2023-10-05 07:00:10,775 INFO [StoreOpener-10f773d120b025203d205e5501cc214d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 10f773d120b025203d205e5501cc214d 2023-10-05 07:00:10,777 DEBUG [StoreOpener-10f773d120b025203d205e5501cc214d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/namespace/10f773d120b025203d205e5501cc214d/info 2023-10-05 07:00:10,777 DEBUG [StoreOpener-10f773d120b025203d205e5501cc214d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/namespace/10f773d120b025203d205e5501cc214d/info 2023-10-05 07:00:10,778 INFO [StoreOpener-10f773d120b025203d205e5501cc214d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10f773d120b025203d205e5501cc214d columnFamilyName info 2023-10-05 07:00:10,779 INFO [StoreOpener-10f773d120b025203d205e5501cc214d-1] regionserver.HStore(310): Store=10f773d120b025203d205e5501cc214d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:00:10,781 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/namespace/10f773d120b025203d205e5501cc214d 2023-10-05 07:00:10,782 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/namespace/10f773d120b025203d205e5501cc214d 2023-10-05 07:00:10,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 10f773d120b025203d205e5501cc214d 2023-10-05 07:00:10,791 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/namespace/10f773d120b025203d205e5501cc214d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:00:10,792 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 10f773d120b025203d205e5501cc214d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71257135, jitterRate=0.06181405484676361}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:00:10,792 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 10f773d120b025203d205e5501cc214d: 2023-10-05 07:00:10,794 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d., pid=6, masterSystemTime=1696489210761 2023-10-05 07:00:10,799 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d. 2023-10-05 07:00:10,799 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d. 2023-10-05 07:00:10,801 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=10f773d120b025203d205e5501cc214d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:10,801 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1696489210800"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489210800"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489210800"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489210800"}]},"ts":"1696489210800"} 2023-10-05 07:00:10,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-05 07:00:10,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 10f773d120b025203d205e5501cc214d, server=jenkins-hbase4.apache.org,33577,1696489207986 in 202 msec 2023-10-05 07:00:10,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-05 07:00:10,816 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=10f773d120b025203d205e5501cc214d, ASSIGN in 369 msec 2023-10-05 07:00:10,817 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 07:00:10,817 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489210817"}]},"ts":"1696489210817"} 2023-10-05 07:00:10,820 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-05 07:00:10,823 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 07:00:10,826 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 560 msec 2023-10-05 07:00:10,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-05 07:00:10,877 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-05 07:00:10,877 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 07:00:10,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:10,903 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:10,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-05 07:00:10,936 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-05 07:00:10,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-10-05 07:00:10,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-05 07:00:10,962 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-05 07:00:10,967 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-10-05 07:00:10,978 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-05 07:00:10,981 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-05 07:00:10,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.870sec 2023-10-05 07:00:10,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-05 07:00:10,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-05 07:00:10,986 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-05 07:00:10,987 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33507,1696489206530-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-05 07:00:10,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33507,1696489206530-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-05 07:00:11,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-05 07:00:11,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-10-05 07:00:11,013 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 07:00:11,015 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 07:00:11,018 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/hbase/acl/db466438afcbe211bce2591ee5f088a3 2023-10-05 07:00:11,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-10-05 07:00:11,018 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/hbase/acl/db466438afcbe211bce2591ee5f088a3 empty. 2023-10-05 07:00:11,021 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/hbase/acl/db466438afcbe211bce2591ee5f088a3 2023-10-05 07:00:11,021 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-10-05 07:00:11,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 07:00:11,048 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-10-05 07:00:11,050 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => db466438afcbe211bce2591ee5f088a3, NAME => 'hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp 2023-10-05 07:00:11,073 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:11,074 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing db466438afcbe211bce2591ee5f088a3, disabling compactions & flushes 2023-10-05 07:00:11,074 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3. 2023-10-05 07:00:11,074 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3. 2023-10-05 07:00:11,074 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3. after waiting 0 ms 2023-10-05 07:00:11,074 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3. 2023-10-05 07:00:11,074 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3. 2023-10-05 07:00:11,074 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for db466438afcbe211bce2591ee5f088a3: 2023-10-05 07:00:11,075 DEBUG [Listener at localhost/45249] zookeeper.ReadOnlyZKClient(139): Connect 0x6bf08614 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:11,080 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 07:00:11,082 DEBUG [Listener at localhost/45249] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52492d35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:11,082 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696489211081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489211081"}]},"ts":"1696489211081"} 2023-10-05 07:00:11,086 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-05 07:00:11,089 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 07:00:11,089 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489211089"}]},"ts":"1696489211089"} 2023-10-05 07:00:11,092 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-10-05 07:00:11,098 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 07:00:11,099 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 07:00:11,100 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 07:00:11,100 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 07:00:11,100 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 07:00:11,100 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=db466438afcbe211bce2591ee5f088a3, ASSIGN}] 2023-10-05 07:00:11,100 DEBUG [hconnection-0x5f69858d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:11,103 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=db466438afcbe211bce2591ee5f088a3, ASSIGN 2023-10-05 07:00:11,104 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=db466438afcbe211bce2591ee5f088a3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39927,1696489208029; forceNewPlan=false, retain=false 2023-10-05 07:00:11,113 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:11,115 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33507,1696489206530 2023-10-05 07:00:11,115 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-10-05 07:00:11,116 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/test.cache.data in system properties and HBase conf 2023-10-05 07:00:11,116 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop.tmp.dir in system properties and HBase conf 2023-10-05 07:00:11,116 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop.log.dir in system properties and HBase conf 2023-10-05 07:00:11,116 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-05 07:00:11,116 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-05 07:00:11,116 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-05 07:00:11,116 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-05 07:00:11,116 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-05 07:00:11,116 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-05 07:00:11,116 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 07:00:11,116 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-05 07:00:11,116 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-05 07:00:11,117 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-05 07:00:11,117 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 07:00:11,117 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-05 07:00:11,117 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/nfs.dump.dir in system properties and HBase conf 2023-10-05 07:00:11,117 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/java.io.tmpdir in system properties and HBase conf 2023-10-05 07:00:11,117 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-05 07:00:11,117 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-05 07:00:11,117 INFO [Listener at localhost/45249] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-10-05 07:00:11,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 07:00:11,254 INFO [jenkins-hbase4:33507] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 07:00:11,255 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=db466438afcbe211bce2591ee5f088a3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:11,256 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696489211255"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489211255"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489211255"}]},"ts":"1696489211255"} 2023-10-05 07:00:11,259 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure db466438afcbe211bce2591ee5f088a3, server=jenkins-hbase4.apache.org,39927,1696489208029}] 2023-10-05 07:00:11,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 07:00:11,414 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:11,414 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 07:00:11,416 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55462, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 07:00:11,423 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3. 2023-10-05 07:00:11,424 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db466438afcbe211bce2591ee5f088a3, NAME => 'hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3.', STARTKEY => '', ENDKEY => ''} 2023-10-05 07:00:11,424 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3. service=AccessControlService 2023-10-05 07:00:11,424 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:00:11,425 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl db466438afcbe211bce2591ee5f088a3 2023-10-05 07:00:11,425 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:11,425 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for db466438afcbe211bce2591ee5f088a3 2023-10-05 07:00:11,425 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for db466438afcbe211bce2591ee5f088a3 2023-10-05 07:00:11,427 INFO [StoreOpener-db466438afcbe211bce2591ee5f088a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region db466438afcbe211bce2591ee5f088a3 2023-10-05 07:00:11,429 DEBUG [StoreOpener-db466438afcbe211bce2591ee5f088a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/acl/db466438afcbe211bce2591ee5f088a3/l 2023-10-05 07:00:11,429 DEBUG [StoreOpener-db466438afcbe211bce2591ee5f088a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/acl/db466438afcbe211bce2591ee5f088a3/l 2023-10-05 07:00:11,430 INFO [StoreOpener-db466438afcbe211bce2591ee5f088a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db466438afcbe211bce2591ee5f088a3 columnFamilyName l 2023-10-05 07:00:11,430 INFO [StoreOpener-db466438afcbe211bce2591ee5f088a3-1] regionserver.HStore(310): Store=db466438afcbe211bce2591ee5f088a3/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:00:11,432 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/acl/db466438afcbe211bce2591ee5f088a3 2023-10-05 07:00:11,434 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/acl/db466438afcbe211bce2591ee5f088a3 2023-10-05 07:00:11,438 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for db466438afcbe211bce2591ee5f088a3 2023-10-05 07:00:11,443 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/acl/db466438afcbe211bce2591ee5f088a3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:00:11,444 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened db466438afcbe211bce2591ee5f088a3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74157680, jitterRate=0.10503554344177246}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:00:11,444 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for db466438afcbe211bce2591ee5f088a3: 2023-10-05 07:00:11,446 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3., pid=11, masterSystemTime=1696489211414 2023-10-05 07:00:11,454 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3. 2023-10-05 07:00:11,455 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3. 2023-10-05 07:00:11,456 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=db466438afcbe211bce2591ee5f088a3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:11,456 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1696489211456"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489211456"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489211456"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489211456"}]},"ts":"1696489211456"} 2023-10-05 07:00:11,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-05 07:00:11,467 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure db466438afcbe211bce2591ee5f088a3, server=jenkins-hbase4.apache.org,39927,1696489208029 in 201 msec 2023-10-05 07:00:11,471 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-05 07:00:11,471 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=db466438afcbe211bce2591ee5f088a3, ASSIGN in 367 msec 2023-10-05 07:00:11,473 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 07:00:11,473 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489211473"}]},"ts":"1696489211473"} 2023-10-05 07:00:11,476 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-10-05 07:00:11,480 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 07:00:11,483 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 471 msec 2023-10-05 07:00:11,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-05 07:00:11,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-10-05 07:00:11,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-05 07:00:12,354 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 07:00:12,708 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 07:00:12,715 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46785_jobhistory____q6xlcr/webapp 2023-10-05 07:00:12,878 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-10-05 07:00:12,879 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-10-05 07:00:12,879 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 07:00:12,882 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 07:00:12,970 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 07:00:13,303 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 07:00:13,662 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-10-05 07:00:13,701 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46785 2023-10-05 07:00:13,849 WARN [Listener at jenkins-hbase4.apache.org/41951] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 07:00:14,100 WARN [Listener at jenkins-hbase4.apache.org/41951] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 07:00:14,101 INFO [Listener at jenkins-hbase4.apache.org/41951] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 07:00:14,108 INFO [Listener at jenkins-hbase4.apache.org/41951] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41893_cluster____tokkpb/webapp 2023-10-05 07:00:14,178 INFO [Listener at jenkins-hbase4.apache.org/41951] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 07:00:14,178 INFO [Listener at jenkins-hbase4.apache.org/41951] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-10-05 07:00:14,178 INFO [Listener at jenkins-hbase4.apache.org/41951] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 07:00:14,179 INFO [Listener at jenkins-hbase4.apache.org/41951] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 07:00:14,189 INFO [Listener at jenkins-hbase4.apache.org/41951] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 07:00:14,402 INFO [Listener at jenkins-hbase4.apache.org/41951] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 07:00:14,531 INFO [Listener at jenkins-hbase4.apache.org/41951] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 07:00:14,542 INFO [Listener at jenkins-hbase4.apache.org/41951] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41893 2023-10-05 07:00:15,026 WARN [Listener at jenkins-hbase4.apache.org/33323] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 07:00:15,055 WARN [Listener at jenkins-hbase4.apache.org/33323] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 07:00:15,056 INFO [Listener at jenkins-hbase4.apache.org/33323] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 07:00:15,079 INFO [Listener at jenkins-hbase4.apache.org/33323] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33401_node____.jmptrh/webapp 2023-10-05 07:00:15,160 INFO [Listener at jenkins-hbase4.apache.org/33323] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-05 07:00:15,160 INFO [Listener at jenkins-hbase4.apache.org/33323] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 07:00:15,160 INFO [Listener at jenkins-hbase4.apache.org/33323] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 07:00:15,161 INFO [Listener at jenkins-hbase4.apache.org/33323] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 07:00:15,169 INFO [Listener at jenkins-hbase4.apache.org/33323] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 07:00:15,192 INFO [Listener at jenkins-hbase4.apache.org/33323] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 07:00:15,288 INFO [Listener at jenkins-hbase4.apache.org/33323] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 07:00:15,298 INFO [Listener at jenkins-hbase4.apache.org/33323] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33401 2023-10-05 07:00:15,457 WARN [Listener at jenkins-hbase4.apache.org/36167] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-05 07:00:15,463 WARN [Listener at jenkins-hbase4.apache.org/36167] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-10-05 07:00:15,463 INFO [Listener at jenkins-hbase4.apache.org/36167] log.Slf4jLog(67): jetty-6.1.26 2023-10-05 07:00:15,474 INFO [Listener at jenkins-hbase4.apache.org/36167] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45425_node____.47x018/webapp 2023-10-05 07:00:15,551 INFO [Listener at jenkins-hbase4.apache.org/36167] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-10-05 07:00:15,552 INFO [Listener at jenkins-hbase4.apache.org/36167] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-10-05 07:00:15,552 INFO [Listener at jenkins-hbase4.apache.org/36167] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-10-05 07:00:15,552 INFO [Listener at jenkins-hbase4.apache.org/36167] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-10-05 07:00:15,564 INFO [Listener at jenkins-hbase4.apache.org/36167] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 07:00:15,581 INFO [Listener at jenkins-hbase4.apache.org/36167] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 07:00:15,625 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 07:00:15,667 INFO [Listener at jenkins-hbase4.apache.org/36167] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-10-05 07:00:15,685 INFO [Listener at jenkins-hbase4.apache.org/36167] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45425 2023-10-05 07:00:15,724 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-10-05 07:00:15,726 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 07:00:15,798 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=165, AvailableMemoryMB=6909 2023-10-05 07:00:15,798 WARN [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-10-05 07:00:15,816 DEBUG [Listener at jenkins-hbase4.apache.org/36167] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-05 07:00:15,821 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-05 07:00:15,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 07:00:15,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-10-05 07:00:15,838 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 07:00:15,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-10-05 07:00:15,841 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 07:00:15,843 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-10-05 07:00:15,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 07:00:15,845 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-05 07:00:15,845 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546 2023-10-05 07:00:15,846 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-05 07:00:15,846 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546 empty. 2023-10-05 07:00:15,850 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1 2023-10-05 07:00:15,850 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546 2023-10-05 07:00:15,852 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1 empty. 2023-10-05 07:00:15,853 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1 2023-10-05 07:00:15,854 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-05 07:00:15,890 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-10-05 07:00:15,891 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2080bd760d06154ab6de3771303fd546, NAME => 'testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp 2023-10-05 07:00:15,892 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0dfb90c1494a30faa587311dce234ff1, NAME => 'testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp 2023-10-05 07:00:15,943 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:15,943 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 0dfb90c1494a30faa587311dce234ff1, disabling compactions & flushes 2023-10-05 07:00:15,943 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. 2023-10-05 07:00:15,943 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. 2023-10-05 07:00:15,943 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. after waiting 0 ms 2023-10-05 07:00:15,943 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. 2023-10-05 07:00:15,943 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. 2023-10-05 07:00:15,943 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 0dfb90c1494a30faa587311dce234ff1: 2023-10-05 07:00:15,943 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:15,944 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 2080bd760d06154ab6de3771303fd546, disabling compactions & flushes 2023-10-05 07:00:15,944 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:15,944 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:15,944 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. after waiting 0 ms 2023-10-05 07:00:15,944 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:15,944 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:15,944 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 2080bd760d06154ab6de3771303fd546: 2023-10-05 07:00:15,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 07:00:15,948 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 07:00:15,950 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696489215950"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489215950"}]},"ts":"1696489215950"} 2023-10-05 07:00:15,950 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696489215950"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489215950"}]},"ts":"1696489215950"} 2023-10-05 07:00:16,003 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 07:00:16,005 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 07:00:16,005 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489216005"}]},"ts":"1696489216005"} 2023-10-05 07:00:16,007 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-10-05 07:00:16,014 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 07:00:16,016 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 07:00:16,016 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 07:00:16,016 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 07:00:16,016 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 07:00:16,017 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2080bd760d06154ab6de3771303fd546, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0dfb90c1494a30faa587311dce234ff1, ASSIGN}] 2023-10-05 07:00:16,020 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2080bd760d06154ab6de3771303fd546, ASSIGN 2023-10-05 07:00:16,020 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0dfb90c1494a30faa587311dce234ff1, ASSIGN 2023-10-05 07:00:16,022 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2080bd760d06154ab6de3771303fd546, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33577,1696489207986; forceNewPlan=false, retain=false 2023-10-05 07:00:16,022 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0dfb90c1494a30faa587311dce234ff1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39927,1696489208029; forceNewPlan=false, retain=false 2023-10-05 07:00:16,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 07:00:16,172 INFO [jenkins-hbase4:33507] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 07:00:16,175 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=2080bd760d06154ab6de3771303fd546, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:16,175 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0dfb90c1494a30faa587311dce234ff1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:16,176 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696489216175"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489216175"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489216175"}]},"ts":"1696489216175"} 2023-10-05 07:00:16,176 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696489216175"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489216175"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489216175"}]},"ts":"1696489216175"} 2023-10-05 07:00:16,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 2080bd760d06154ab6de3771303fd546, server=jenkins-hbase4.apache.org,33577,1696489207986}] 2023-10-05 07:00:16,180 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 0dfb90c1494a30faa587311dce234ff1, server=jenkins-hbase4.apache.org,39927,1696489208029}] 2023-10-05 07:00:16,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:16,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2080bd760d06154ab6de3771303fd546, NAME => 'testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 07:00:16,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. service=AccessControlService 2023-10-05 07:00:16,339 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:00:16,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 2080bd760d06154ab6de3771303fd546 2023-10-05 07:00:16,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:16,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2080bd760d06154ab6de3771303fd546 2023-10-05 07:00:16,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2080bd760d06154ab6de3771303fd546 2023-10-05 07:00:16,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. 2023-10-05 07:00:16,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0dfb90c1494a30faa587311dce234ff1, NAME => 'testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 07:00:16,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. service=AccessControlService 2023-10-05 07:00:16,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:00:16,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 0dfb90c1494a30faa587311dce234ff1 2023-10-05 07:00:16,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:16,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0dfb90c1494a30faa587311dce234ff1 2023-10-05 07:00:16,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0dfb90c1494a30faa587311dce234ff1 2023-10-05 07:00:16,347 INFO [StoreOpener-2080bd760d06154ab6de3771303fd546-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2080bd760d06154ab6de3771303fd546 2023-10-05 07:00:16,347 INFO [StoreOpener-0dfb90c1494a30faa587311dce234ff1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0dfb90c1494a30faa587311dce234ff1 2023-10-05 07:00:16,349 DEBUG [StoreOpener-2080bd760d06154ab6de3771303fd546-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546/cf 2023-10-05 07:00:16,349 DEBUG [StoreOpener-2080bd760d06154ab6de3771303fd546-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546/cf 2023-10-05 07:00:16,349 DEBUG [StoreOpener-0dfb90c1494a30faa587311dce234ff1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1/cf 2023-10-05 07:00:16,350 DEBUG [StoreOpener-0dfb90c1494a30faa587311dce234ff1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1/cf 2023-10-05 07:00:16,353 INFO [StoreOpener-0dfb90c1494a30faa587311dce234ff1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0dfb90c1494a30faa587311dce234ff1 columnFamilyName cf 2023-10-05 07:00:16,353 INFO [StoreOpener-2080bd760d06154ab6de3771303fd546-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2080bd760d06154ab6de3771303fd546 columnFamilyName cf 2023-10-05 07:00:16,356 INFO [StoreOpener-2080bd760d06154ab6de3771303fd546-1] regionserver.HStore(310): Store=2080bd760d06154ab6de3771303fd546/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:00:16,356 INFO [StoreOpener-0dfb90c1494a30faa587311dce234ff1-1] regionserver.HStore(310): Store=0dfb90c1494a30faa587311dce234ff1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:00:16,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1 2023-10-05 07:00:16,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546 2023-10-05 07:00:16,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546 2023-10-05 07:00:16,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1 2023-10-05 07:00:16,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2080bd760d06154ab6de3771303fd546 2023-10-05 07:00:16,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0dfb90c1494a30faa587311dce234ff1 2023-10-05 07:00:16,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:00:16,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:00:16,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0dfb90c1494a30faa587311dce234ff1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70967975, jitterRate=0.05750523507595062}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:00:16,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2080bd760d06154ab6de3771303fd546; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69942790, jitterRate=0.04222878813743591}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:00:16,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0dfb90c1494a30faa587311dce234ff1: 2023-10-05 07:00:16,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2080bd760d06154ab6de3771303fd546: 2023-10-05 07:00:16,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1., pid=16, masterSystemTime=1696489216333 2023-10-05 07:00:16,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546., pid=15, masterSystemTime=1696489216332 2023-10-05 07:00:16,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. 2023-10-05 07:00:16,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. 2023-10-05 07:00:16,383 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0dfb90c1494a30faa587311dce234ff1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:16,383 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696489216383"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489216383"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489216383"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489216383"}]},"ts":"1696489216383"} 2023-10-05 07:00:16,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:16,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:16,384 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=2080bd760d06154ab6de3771303fd546, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:16,385 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696489216384"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489216384"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489216384"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489216384"}]},"ts":"1696489216384"} 2023-10-05 07:00:16,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-10-05 07:00:16,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 0dfb90c1494a30faa587311dce234ff1, server=jenkins-hbase4.apache.org,39927,1696489208029 in 207 msec 2023-10-05 07:00:16,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-10-05 07:00:16,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 2080bd760d06154ab6de3771303fd546, server=jenkins-hbase4.apache.org,33577,1696489207986 in 210 msec 2023-10-05 07:00:16,395 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0dfb90c1494a30faa587311dce234ff1, ASSIGN in 374 msec 2023-10-05 07:00:16,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-10-05 07:00:16,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2080bd760d06154ab6de3771303fd546, ASSIGN in 377 msec 2023-10-05 07:00:16,399 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 07:00:16,399 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489216399"}]},"ts":"1696489216399"} 2023-10-05 07:00:16,401 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-10-05 07:00:16,407 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 07:00:16,413 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-10-05 07:00:16,420 DEBUG [PEWorker-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:16,423 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:16,428 DEBUG [hconnection-0x1e8d6bd8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:16,431 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58570, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-10-05 07:00:16,439 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39927] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 07:00:16,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 07:00:16,472 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:16,472 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:16,472 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:16,472 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:16,473 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 07:00:16,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 07:00:16,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 07:00:16,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 07:00:16,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-10-05 07:00:16,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 647 msec 2023-10-05 07:00:16,712 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:00:16,713 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-10-05 07:00:16,714 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:00:16,714 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-10-05 07:00:16,714 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-05 07:00:16,714 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-10-05 07:00:16,714 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:00:16,714 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-10-05 07:00:16,715 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-05 07:00:16,715 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-05 07:00:16,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-10-05 07:00:16,952 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-10-05 07:00:16,956 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-05 07:00:16,958 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:16,960 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 07:00:16,987 DEBUG [hconnection-0x5f69858d-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:16,990 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:16,993 DEBUG [hconnection-0x5f69858d-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:16,998 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:17,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 07:00:17,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696489217017 (current time:1696489217017). 2023-10-05 07:00:17,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 07:00:17,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x42f26c9d to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:17,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1740a9ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:17,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:17,032 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:17,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42f26c9d to 127.0.0.1:58805 2023-10-05 07:00:17,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:00:17,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x5f329e74 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:17,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25cc5551, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:17,046 DEBUG [hconnection-0x7b79eaca-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:17,047 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:17,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:17,054 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:17,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f329e74 to 127.0.0.1:58805 2023-10-05 07:00:17,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:00:17,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 07:00:17,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 07:00:17,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 07:00:17,093 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot, current working dir path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 07:00:17,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 07:00:17,118 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 07:00:17,120 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696489817120 2023-10-05 07:00:17,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 07:00:17,120 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-05 07:00:17,123 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 07:00:17,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 07:00:17,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-10-05 07:00:17,127 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 07:00:17,128 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696489817128 2023-10-05 07:00:17,128 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 07:00:17,129 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 07:00:17,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,157 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-10-05 07:00:17,157 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:17,158 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-10-05 07:00:17,158 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-05 07:00:17,159 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,159 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,167 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:17,167 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:17,167 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:17,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:17,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:17,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:17,167 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:17,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:17,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:17,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,168 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,168 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,168 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,168 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 07:00:17,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 07:00:17,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 07:00:17,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-10-05 07:00:17,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,169 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 07:00:17,170 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 07:00:17,170 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 07:00:17,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,173 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 07:00:17,173 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 07:00:17,173 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:17,173 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:17,174 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 07:00:17,175 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 07:00:17,175 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 07:00:17,175 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 07:00:17,175 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 07:00:17,175 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:17,175 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 07:00:17,176 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 07:00:17,176 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-10-05 07:00:17,176 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 07:00:17,176 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-10-05 07:00:17,178 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,179 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,179 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,179 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,179 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:17,180 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,180 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:17,180 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,180 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:17,181 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,181 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:17,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:17,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:17,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:17,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:17,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:17,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-05 07:00:17,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16f6b3f0[Count = 1] remaining members to acquire global barrier 2023-10-05 07:00:17,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:17,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:17,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:17,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:17,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:17,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:17,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-10-05 07:00:17,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16f6b3f0[Count = 0] remaining members to acquire global barrier 2023-10-05 07:00:17,187 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-05 07:00:17,187 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,191 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,191 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,191 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,191 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 07:00:17,191 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,192 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 07:00:17,192 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 07:00:17,192 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 07:00:17,192 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,192 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35011,1696489207914' in zk 2023-10-05 07:00:17,192 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 07:00:17,193 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:00:17,193 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:00:17,193 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:17,193 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. started... 2023-10-05 07:00:17,196 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2080bd760d06154ab6de3771303fd546: 2023-10-05 07:00:17,198 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:00:17,198 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:00:17,198 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. 2023-10-05 07:00:17,198 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. started... 2023-10-05 07:00:17,198 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 07:00:17,198 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:17,199 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0dfb90c1494a30faa587311dce234ff1: 2023-10-05 07:00:17,199 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 07:00:17,200 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,201 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,206 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:00:17,206 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:00:17,210 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 07:00:17,210 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 07:00:17,229 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:00:17,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 07:00:17,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 07:00:17,236 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 07:00:17,240 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. completed. 2023-10-05 07:00:17,240 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. 2023-10-05 07:00:17,241 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:00:17,241 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:00:17,241 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,241 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 07:00:17,241 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39927,1696489208029' in zk 2023-10-05 07:00:17,243 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. completed. 2023-10-05 07:00:17,243 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:17,243 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:00:17,243 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:00:17,243 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,243 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-10-05 07:00:17,243 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33577,1696489207986' in zk 2023-10-05 07:00:17,244 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:17,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:17,244 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 07:00:17,244 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:17,244 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 07:00:17,246 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 07:00:17,247 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:17,246 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,247 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-10-05 07:00:17,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:17,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:17,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:17,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:17,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:17,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39927,1696489208029': 2023-10-05 07:00:17,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-05 07:00:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:17,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:17,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:17,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:17,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:17,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:17,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33577,1696489207986': 2023-10-05 07:00:17,258 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-05 07:00:17,258 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-10-05 07:00:17,258 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 07:00:17,258 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 07:00:17,258 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,258 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 07:00:17,262 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,262 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,262 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,262 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:17,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,262 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:17,262 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:17,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:17,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,263 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:17,263 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:17,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:17,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:17,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:17,264 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:17,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:17,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:17,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:17,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,265 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:17,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:17,267 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:17,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,268 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:17,268 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,281 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:17,281 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:17,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:17,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:17,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:17,282 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:17,281 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:17,281 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:17,282 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:17,281 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,282 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:17,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:17,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:17,282 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:17,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:17,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:17,283 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-05 07:00:17,283 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,283 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 07:00:17,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:17,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:17,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:17,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:17,283 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,284 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,284 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:17,284 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,284 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,284 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,284 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,284 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:17,284 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,284 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 07:00:17,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,368 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-05 07:00:17,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,368 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:17,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696489217120Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696489217303 (+183 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1696489217303Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1696489217304 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1696489217325 (+21 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1696489217355 (+30 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696489217368 (+13 ms) 2023-10-05 07:00:17,371 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 07:00:17,373 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 249 msec 2023-10-05 07:00:17,436 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:00:17,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 07:00:17,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 07:00:17,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33577] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 07:00:17,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39927] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 07:00:17,464 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-10-05 07:00:17,464 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:17,465 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 07:00:17,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 07:00:17,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696489217481 (current time:1696489217481). 2023-10-05 07:00:17,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 07:00:17,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x26e64d21 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:17,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3eb4bb63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:17,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:17,493 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:17,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26e64d21 to 127.0.0.1:58805 2023-10-05 07:00:17,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:00:17,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x187d507c to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:17,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c668917, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:17,510 DEBUG [hconnection-0x1792445b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:17,513 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:17,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:17,521 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51870, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:17,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x187d507c to 127.0.0.1:58805 2023-10-05 07:00:17,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:00:17,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-10-05 07:00:17,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 07:00:17,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 07:00:17,527 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot, current working dir path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 07:00:17,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 07:00:17,531 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 07:00:17,532 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1696489817532 2023-10-05 07:00:17,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-10-05 07:00:17,532 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-10-05 07:00:17,533 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 07:00:17,534 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 07:00:17,535 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-10-05 07:00:17,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 07:00:17,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-10-05 07:00:17,538 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 07:00:17,539 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1696489817539 2023-10-05 07:00:17,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-10-05 07:00:17,556 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-10-05 07:00:17,556 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:17,557 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-10-05 07:00:17,557 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-10-05 07:00:17,557 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,557 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,559 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:17,559 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:17,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:17,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:17,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:17,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:17,559 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,559 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:17,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:17,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:17,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,560 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,560 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,560 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 07:00:17,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 07:00:17,560 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 07:00:17,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-10-05 07:00:17,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,561 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 07:00:17,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,561 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 07:00:17,561 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-10-05 07:00:17,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 07:00:17,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 07:00:17,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-10-05 07:00:17,561 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 07:00:17,561 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 07:00:17,561 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:17,561 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-10-05 07:00:17,563 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 07:00:17,563 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:17,561 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:17,564 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 07:00:17,565 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 07:00:17,565 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-10-05 07:00:17,565 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 07:00:17,563 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-10-05 07:00:17,565 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 07:00:17,565 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 07:00:17,565 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-10-05 07:00:17,567 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,567 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:17,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:17,569 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,569 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:17,569 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,569 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:17,569 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,570 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:17,570 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,570 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:17,570 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:17,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 07:00:17,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:17,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:17,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-05 07:00:17,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@164fda1b[Count = 1] remaining members to acquire global barrier 2023-10-05 07:00:17,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:17,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:17,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:17,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:17,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 07:00:17,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:17,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:17,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-10-05 07:00:17,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@164fda1b[Count = 0] remaining members to acquire global barrier 2023-10-05 07:00:17,575 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-10-05 07:00:17,575 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,579 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,579 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,579 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,579 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,579 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 07:00:17,579 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 07:00:17,580 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 07:00:17,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:17,580 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35011,1696489207914' in zk 2023-10-05 07:00:17,580 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-10-05 07:00:17,580 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:00:17,580 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:00:17,580 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:17,580 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,580 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 07:00:17,580 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. started... 2023-10-05 07:00:17,580 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. 2023-10-05 07:00:17,580 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:00:17,580 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:00:17,580 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. started... 2023-10-05 07:00:17,580 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2080bd760d06154ab6de3771303fd546 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-05 07:00:17,581 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0dfb90c1494a30faa587311dce234ff1 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-05 07:00:17,583 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 07:00:17,583 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:17,583 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 07:00:17,634 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:00:17,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 07:00:17,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 07:00:17,636 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 07:00:17,736 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005e305872d7b7145ec98df3b13f77bc8b8 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005e305872d7b7145ec98df3b13f77bc8b8 2023-10-05 07:00:17,759 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546/.tmp/cf/1241ab1c3c5f4211afe536d84c9fc25e 2023-10-05 07:00:17,769 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546/.tmp/cf/1241ab1c3c5f4211afe536d84c9fc25e as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546/cf/1241ab1c3c5f4211afe536d84c9fc25e 2023-10-05 07:00:17,777 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546/cf/1241ab1c3c5f4211afe536d84c9fc25e, entries=3, sequenceid=6, filesize=5.4 K 2023-10-05 07:00:17,779 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 2080bd760d06154ab6de3771303fd546 in 199ms, sequenceid=6, compaction requested=false 2023-10-05 07:00:17,779 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-10-05 07:00:17,780 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2080bd760d06154ab6de3771303fd546: 2023-10-05 07:00:17,780 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 07:00:17,781 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:00:17,781 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546/cf/1241ab1c3c5f4211afe536d84c9fc25e] hfiles 2023-10-05 07:00:17,781 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546/cf/1241ab1c3c5f4211afe536d84c9fc25e for snapshot=snaptb0-testExportWithTargetName 2023-10-05 07:00:17,800 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. completed. 2023-10-05 07:00:17,801 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:17,801 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:00:17,805 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:00:17,805 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,805 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 07:00:17,805 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33577,1696489207986' in zk 2023-10-05 07:00:17,807 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 07:00:17,807 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,807 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:17,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:17,808 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 07:00:17,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 07:00:17,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:17,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 07:00:17,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:17,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:17,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33577,1696489207986': 2023-10-05 07:00:17,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-10-05 07:00:17,836 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:00:17,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 07:00:17,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 07:00:17,838 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-05 07:00:18,096 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310051008eac735fb41aaa5944d72a951f397 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310051008eac735fb41aaa5944d72a951f397 2023-10-05 07:00:18,114 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1/.tmp/cf/1f9a07d3bb4645659af83d10c82a32e4 2023-10-05 07:00:18,123 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1/.tmp/cf/1f9a07d3bb4645659af83d10c82a32e4 as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1/cf/1f9a07d3bb4645659af83d10c82a32e4 2023-10-05 07:00:18,138 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:00:18,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 07:00:18,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-10-05 07:00:18,145 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-05 07:00:18,147 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1/cf/1f9a07d3bb4645659af83d10c82a32e4, entries=47, sequenceid=6, filesize=12.8 K 2023-10-05 07:00:18,150 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 0dfb90c1494a30faa587311dce234ff1 in 569ms, sequenceid=6, compaction requested=false 2023-10-05 07:00:18,151 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0dfb90c1494a30faa587311dce234ff1: 2023-10-05 07:00:18,151 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 07:00:18,151 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:00:18,151 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1/cf/1f9a07d3bb4645659af83d10c82a32e4] hfiles 2023-10-05 07:00:18,151 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1/cf/1f9a07d3bb4645659af83d10c82a32e4 for snapshot=snaptb0-testExportWithTargetName 2023-10-05 07:00:18,165 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. completed. 2023-10-05 07:00:18,165 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. 2023-10-05 07:00:18,165 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:00:18,165 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:00:18,165 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:18,165 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-10-05 07:00:18,165 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39927,1696489208029' in zk 2023-10-05 07:00:18,168 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:18,168 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-10-05 07:00:18,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:18,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:18,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:18,168 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:18,168 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-10-05 07:00:18,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:18,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:18,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 07:00:18,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:18,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:18,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:18,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:18,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 07:00:18,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:18,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:18,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:18,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39927,1696489208029': 2023-10-05 07:00:18,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-10-05 07:00:18,173 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-10-05 07:00:18,173 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 07:00:18,173 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 07:00:18,173 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-10-05 07:00:18,173 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 07:00:18,175 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,175 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,175 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:18,175 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:18,175 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,175 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:18,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:18,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,176 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:18,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:18,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:18,176 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:18,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:18,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:18,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:18,177 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:18,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:18,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 07:00:18,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:18,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:18,178 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:18,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 07:00:18,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:18,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:18,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:18,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:18,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-10-05 07:00:18,181 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:18,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:18,181 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:18,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:18,182 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:18,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:18,197 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:18,197 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:18,197 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,197 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:18,197 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:18,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:18,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:18,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:18,197 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:18,197 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:18,197 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:18,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:18,198 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:18,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:18,197 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:18,197 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-10-05 07:00:18,198 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-10-05 07:00:18,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-10-05 07:00:18,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 07:00:18,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:18,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:18,197 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:18,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:18,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:18,198 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,201 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:18,201 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,201 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:18,201 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:18,201 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,201 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:18,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310051008eac735fb41aaa5944d72a951f397, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005e305872d7b7145ec98df3b13f77bc8b8] mob files 2023-10-05 07:00:18,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310051008eac735fb41aaa5944d72a951f397 2023-10-05 07:00:18,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:18,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:18,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005e305872d7b7145ec98df3b13f77bc8b8 2023-10-05 07:00:18,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-10-05 07:00:18,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,258 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-10-05 07:00:18,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,259 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-10-05 07:00:18,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1696489217532Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1696489218219 (+687 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1696489218219Loading Region manifests for snaptb0-testExportWithTargetName at 1696489218219Writing data manifest for snaptb0-testExportWithTargetName at 1696489218224 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1696489218245 (+21 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1696489218258 (+13 ms) 2023-10-05 07:00:18,261 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-10-05 07:00:18,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 728 msec 2023-10-05 07:00:18,645 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:00:18,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-10-05 07:00:18,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 07:00:18,649 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489218649 2023-10-05 07:00:18,650 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41859, tgtDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489218649, rawTgtDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489218649, srcFsUri=hdfs://localhost:41859, srcDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:00:18,701 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41859, inputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:00:18,701 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2084652949_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489218649, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489218649/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-05 07:00:18,702 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41859, inputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0, snapshotDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-10-05 07:00:18,726 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489218649/.hbase-snapshot/.tmp/testExportWithTargetName 2023-10-05 07:00:18,794 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:18,795 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:18,795 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:18,796 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:19,719 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop-5328149249026079731.jar 2023-10-05 07:00:19,720 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:19,720 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:19,791 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop-8911292351966053697.jar 2023-10-05 07:00:19,792 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:19,793 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:19,793 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:19,794 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:19,795 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:19,795 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:19,796 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 07:00:19,796 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 07:00:19,797 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 07:00:19,798 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 07:00:19,798 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 07:00:19,799 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 07:00:19,799 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 07:00:19,799 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 07:00:19,800 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 07:00:19,800 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 07:00:19,804 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:00:19,805 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:00:19,805 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:00:19,805 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:00:19,806 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:00:19,807 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:00:19,807 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:00:20,691 WARN [Listener at jenkins-hbase4.apache.org/36167] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 07:00:20,697 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-10-05 07:00:20,708 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-05 07:00:21,200 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 07:00:21,202 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 07:00:21,585 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0001_000001 (auth:SIMPLE) 2023-10-05 07:00:21,845 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 07:00:26,022 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0001_000001 (auth:SIMPLE) 2023-10-05 07:00:28,273 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0001_000001 (auth:SIMPLE) 2023-10-05 07:00:30,970 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0001_000001 (auth:SIMPLE) 2023-10-05 07:00:32,581 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 07:00:32,584 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 07:00:32,598 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-10-05 07:00:32,598 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 07:00:32,599 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 07:00:32,599 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740582836_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-10-05 07:00:32,599 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-10-05 07:00:32,599 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-10-05 07:00:32,599 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740582836_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489218649/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489218649/.hbase-snapshot/testExportWithTargetName 2023-10-05 07:00:32,600 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489218649/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-10-05 07:00:32,600 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489218649/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-10-05 07:00:32,611 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-10-05 07:00:32,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-10-05 07:00:32,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-10-05 07:00:32,631 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489232631"}]},"ts":"1696489232631"} 2023-10-05 07:00:32,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 07:00:32,633 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-10-05 07:00:32,635 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-10-05 07:00:32,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2080bd760d06154ab6de3771303fd546, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0dfb90c1494a30faa587311dce234ff1, UNASSIGN}] 2023-10-05 07:00:32,639 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2080bd760d06154ab6de3771303fd546, UNASSIGN 2023-10-05 07:00:32,639 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0dfb90c1494a30faa587311dce234ff1, UNASSIGN 2023-10-05 07:00:32,640 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=2080bd760d06154ab6de3771303fd546, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:32,640 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0dfb90c1494a30faa587311dce234ff1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:32,640 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696489232640"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489232640"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489232640"}]},"ts":"1696489232640"} 2023-10-05 07:00:32,640 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696489232640"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489232640"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489232640"}]},"ts":"1696489232640"} 2023-10-05 07:00:32,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 2080bd760d06154ab6de3771303fd546, server=jenkins-hbase4.apache.org,33577,1696489207986}] 2023-10-05 07:00:32,643 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 0dfb90c1494a30faa587311dce234ff1, server=jenkins-hbase4.apache.org,39927,1696489208029}] 2023-10-05 07:00:32,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 07:00:32,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0dfb90c1494a30faa587311dce234ff1 2023-10-05 07:00:32,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2080bd760d06154ab6de3771303fd546 2023-10-05 07:00:32,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0dfb90c1494a30faa587311dce234ff1, disabling compactions & flushes 2023-10-05 07:00:32,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2080bd760d06154ab6de3771303fd546, disabling compactions & flushes 2023-10-05 07:00:32,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. 2023-10-05 07:00:32,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:32,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. 2023-10-05 07:00:32,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:32,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. after waiting 0 ms 2023-10-05 07:00:32,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. after waiting 0 ms 2023-10-05 07:00:32,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. 2023-10-05 07:00:32,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:32,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 07:00:32,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 07:00:32,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:00:32,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:00:32,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1. 2023-10-05 07:00:32,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546. 2023-10-05 07:00:32,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0dfb90c1494a30faa587311dce234ff1: 2023-10-05 07:00:32,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2080bd760d06154ab6de3771303fd546: 2023-10-05 07:00:32,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0dfb90c1494a30faa587311dce234ff1 2023-10-05 07:00:32,825 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0dfb90c1494a30faa587311dce234ff1, regionState=CLOSED 2023-10-05 07:00:32,825 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696489232825"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489232825"}]},"ts":"1696489232825"} 2023-10-05 07:00:32,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2080bd760d06154ab6de3771303fd546 2023-10-05 07:00:32,826 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=2080bd760d06154ab6de3771303fd546, regionState=CLOSED 2023-10-05 07:00:32,826 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1696489232826"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489232826"}]},"ts":"1696489232826"} 2023-10-05 07:00:32,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-10-05 07:00:32,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 0dfb90c1494a30faa587311dce234ff1, server=jenkins-hbase4.apache.org,39927,1696489208029 in 184 msec 2023-10-05 07:00:32,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-10-05 07:00:32,832 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 2080bd760d06154ab6de3771303fd546, server=jenkins-hbase4.apache.org,33577,1696489207986 in 186 msec 2023-10-05 07:00:32,833 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0dfb90c1494a30faa587311dce234ff1, UNASSIGN in 193 msec 2023-10-05 07:00:32,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-10-05 07:00:32,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2080bd760d06154ab6de3771303fd546, UNASSIGN in 194 msec 2023-10-05 07:00:32,836 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489232835"}]},"ts":"1696489232835"} 2023-10-05 07:00:32,837 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-10-05 07:00:32,839 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-10-05 07:00:32,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 220 msec 2023-10-05 07:00:32,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-10-05 07:00:32,935 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-10-05 07:00:32,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-10-05 07:00:32,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 07:00:32,950 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 07:00:32,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-10-05 07:00:32,952 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 07:00:32,955 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39927] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-10-05 07:00:32,958 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546 2023-10-05 07:00:32,958 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1 2023-10-05 07:00:32,959 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 07:00:32,959 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 07:00:32,959 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 07:00:32,959 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-10-05 07:00:32,961 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:32,961 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:32,961 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:32,961 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-05 07:00:32,961 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-05 07:00:32,961 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 07:00:32,962 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:32,962 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-05 07:00:32,962 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-10-05 07:00:32,961 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 07:00:32,962 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 07:00:32,962 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 07:00:32,962 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546/cf, FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546/recovered.edits] 2023-10-05 07:00:32,962 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1/cf, FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1/recovered.edits] 2023-10-05 07:00:32,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-05 07:00:32,971 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546/cf/1241ab1c3c5f4211afe536d84c9fc25e to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546/cf/1241ab1c3c5f4211afe536d84c9fc25e 2023-10-05 07:00:32,971 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1/cf/1f9a07d3bb4645659af83d10c82a32e4 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1/cf/1f9a07d3bb4645659af83d10c82a32e4 2023-10-05 07:00:32,975 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1/recovered.edits/9.seqid to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1/recovered.edits/9.seqid 2023-10-05 07:00:32,975 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546/recovered.edits/9.seqid to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546/recovered.edits/9.seqid 2023-10-05 07:00:32,976 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/0dfb90c1494a30faa587311dce234ff1 2023-10-05 07:00:32,976 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportWithTargetName/2080bd760d06154ab6de3771303fd546 2023-10-05 07:00:32,976 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-10-05 07:00:32,977 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-05 07:00:32,977 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-10-05 07:00:32,982 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310051008eac735fb41aaa5944d72a951f397 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202310051008eac735fb41aaa5944d72a951f397 2023-10-05 07:00:32,984 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005e305872d7b7145ec98df3b13f77bc8b8 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20231005e305872d7b7145ec98df3b13f77bc8b8 2023-10-05 07:00:32,984 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-10-05 07:00:32,988 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 07:00:33,009 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-10-05 07:00:33,012 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-10-05 07:00:33,014 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 07:00:33,014 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-10-05 07:00:33,014 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696489233014"}]},"ts":"9223372036854775807"} 2023-10-05 07:00:33,014 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696489233014"}]},"ts":"9223372036854775807"} 2023-10-05 07:00:33,016 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 07:00:33,016 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2080bd760d06154ab6de3771303fd546, NAME => 'testtb-testExportWithTargetName,,1696489215829.2080bd760d06154ab6de3771303fd546.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0dfb90c1494a30faa587311dce234ff1, NAME => 'testtb-testExportWithTargetName,1,1696489215829.0dfb90c1494a30faa587311dce234ff1.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 07:00:33,016 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-10-05 07:00:33,016 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696489233016"}]},"ts":"9223372036854775807"} 2023-10-05 07:00:33,018 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-10-05 07:00:33,021 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-10-05 07:00:33,022 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 80 msec 2023-10-05 07:00:33,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-10-05 07:00:33,069 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-10-05 07:00:33,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-10-05 07:00:33,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-10-05 07:00:33,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-10-05 07:00:33,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportWithTargetName 2023-10-05 07:00:33,130 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 708) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/cluster_7c69a4d7-26dc-b96d-a4e0-1faad6f9ad3a/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740582836_17 at /127.0.0.1:60074 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:33323 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/cluster_7c69a4d7-26dc-b96d-a4e0-1faad6f9ad3a/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1527642923_1 at /127.0.0.1:50894 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:38615 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/cluster_7c69a4d7-26dc-b96d-a4e0-1faad6f9ad3a/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/cluster_7c69a4d7-26dc-b96d-a4e0-1faad6f9ad3a/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:38963 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/cluster_7c69a4d7-26dc-b96d-a4e0-1faad6f9ad3a/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1527642923_1 at /127.0.0.1:60050 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740582836_17 at /127.0.0.1:50910 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/cluster_7c69a4d7-26dc-b96d-a4e0-1faad6f9ad3a/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740582836_17 at /127.0.0.1:52210 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=311 (was 303) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=6111 (was 6909) 2023-10-05 07:00:33,130 WARN [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-10-05 07:00:33,152 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=311, ProcessCount=168, AvailableMemoryMB=6111 2023-10-05 07:00:33,152 WARN [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-10-05 07:00:33,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 07:00:33,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-10-05 07:00:33,160 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 07:00:33,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-10-05 07:00:33,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 07:00:33,163 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 07:00:33,167 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5 2023-10-05 07:00:33,167 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a 2023-10-05 07:00:33,167 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5 empty. 2023-10-05 07:00:33,167 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a empty. 2023-10-05 07:00:33,168 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5 2023-10-05 07:00:33,168 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a 2023-10-05 07:00:33,168 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-05 07:00:33,190 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-05 07:00:33,191 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => e1bcb1c0135408ff7bcfe44e6d7b4ba5, NAME => 'testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp 2023-10-05 07:00:33,192 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => ae10d553a7687c80c98eab07edc4953a, NAME => 'testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp 2023-10-05 07:00:33,225 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:33,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing e1bcb1c0135408ff7bcfe44e6d7b4ba5, disabling compactions & flushes 2023-10-05 07:00:33,226 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:33,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:33,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. after waiting 0 ms 2023-10-05 07:00:33,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:33,226 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:33,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for e1bcb1c0135408ff7bcfe44e6d7b4ba5: 2023-10-05 07:00:33,226 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:33,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing ae10d553a7687c80c98eab07edc4953a, disabling compactions & flushes 2023-10-05 07:00:33,227 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. 2023-10-05 07:00:33,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. 2023-10-05 07:00:33,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. after waiting 0 ms 2023-10-05 07:00:33,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. 2023-10-05 07:00:33,227 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. 2023-10-05 07:00:33,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for ae10d553a7687c80c98eab07edc4953a: 2023-10-05 07:00:33,230 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 07:00:33,232 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696489233231"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489233231"}]},"ts":"1696489233231"} 2023-10-05 07:00:33,232 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696489233231"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489233231"}]},"ts":"1696489233231"} 2023-10-05 07:00:33,234 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 07:00:33,236 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 07:00:33,236 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489233236"}]},"ts":"1696489233236"} 2023-10-05 07:00:33,238 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-10-05 07:00:33,242 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 07:00:33,244 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 07:00:33,244 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 07:00:33,244 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 07:00:33,244 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 07:00:33,244 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e1bcb1c0135408ff7bcfe44e6d7b4ba5, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ae10d553a7687c80c98eab07edc4953a, ASSIGN}] 2023-10-05 07:00:33,248 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ae10d553a7687c80c98eab07edc4953a, ASSIGN 2023-10-05 07:00:33,248 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e1bcb1c0135408ff7bcfe44e6d7b4ba5, ASSIGN 2023-10-05 07:00:33,249 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ae10d553a7687c80c98eab07edc4953a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35011,1696489207914; forceNewPlan=false, retain=false 2023-10-05 07:00:33,249 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e1bcb1c0135408ff7bcfe44e6d7b4ba5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33577,1696489207986; forceNewPlan=false, retain=false 2023-10-05 07:00:33,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 07:00:33,399 INFO [jenkins-hbase4:33507] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 07:00:33,402 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ae10d553a7687c80c98eab07edc4953a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:33,402 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=e1bcb1c0135408ff7bcfe44e6d7b4ba5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:33,403 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696489233402"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489233402"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489233402"}]},"ts":"1696489233402"} 2023-10-05 07:00:33,403 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696489233402"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489233402"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489233402"}]},"ts":"1696489233402"} 2023-10-05 07:00:33,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure ae10d553a7687c80c98eab07edc4953a, server=jenkins-hbase4.apache.org,35011,1696489207914}] 2023-10-05 07:00:33,406 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure e1bcb1c0135408ff7bcfe44e6d7b4ba5, server=jenkins-hbase4.apache.org,33577,1696489207986}] 2023-10-05 07:00:33,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 07:00:33,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:33,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. 2023-10-05 07:00:33,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e1bcb1c0135408ff7bcfe44e6d7b4ba5, NAME => 'testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 07:00:33,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ae10d553a7687c80c98eab07edc4953a, NAME => 'testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 07:00:33,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. service=AccessControlService 2023-10-05 07:00:33,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:00:33,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. service=AccessControlService 2023-10-05 07:00:33,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState e1bcb1c0135408ff7bcfe44e6d7b4ba5 2023-10-05 07:00:33,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:33,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:00:33,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e1bcb1c0135408ff7bcfe44e6d7b4ba5 2023-10-05 07:00:33,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e1bcb1c0135408ff7bcfe44e6d7b4ba5 2023-10-05 07:00:33,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState ae10d553a7687c80c98eab07edc4953a 2023-10-05 07:00:33,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:33,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ae10d553a7687c80c98eab07edc4953a 2023-10-05 07:00:33,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ae10d553a7687c80c98eab07edc4953a 2023-10-05 07:00:33,572 INFO [StoreOpener-ae10d553a7687c80c98eab07edc4953a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ae10d553a7687c80c98eab07edc4953a 2023-10-05 07:00:33,572 INFO [StoreOpener-e1bcb1c0135408ff7bcfe44e6d7b4ba5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e1bcb1c0135408ff7bcfe44e6d7b4ba5 2023-10-05 07:00:33,573 DEBUG [StoreOpener-ae10d553a7687c80c98eab07edc4953a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a/cf 2023-10-05 07:00:33,573 DEBUG [StoreOpener-e1bcb1c0135408ff7bcfe44e6d7b4ba5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5/cf 2023-10-05 07:00:33,573 DEBUG [StoreOpener-e1bcb1c0135408ff7bcfe44e6d7b4ba5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5/cf 2023-10-05 07:00:33,573 DEBUG [StoreOpener-ae10d553a7687c80c98eab07edc4953a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a/cf 2023-10-05 07:00:33,574 INFO [StoreOpener-e1bcb1c0135408ff7bcfe44e6d7b4ba5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1bcb1c0135408ff7bcfe44e6d7b4ba5 columnFamilyName cf 2023-10-05 07:00:33,574 INFO [StoreOpener-ae10d553a7687c80c98eab07edc4953a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae10d553a7687c80c98eab07edc4953a columnFamilyName cf 2023-10-05 07:00:33,575 INFO [StoreOpener-e1bcb1c0135408ff7bcfe44e6d7b4ba5-1] regionserver.HStore(310): Store=e1bcb1c0135408ff7bcfe44e6d7b4ba5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:00:33,577 INFO [StoreOpener-ae10d553a7687c80c98eab07edc4953a-1] regionserver.HStore(310): Store=ae10d553a7687c80c98eab07edc4953a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:00:33,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5 2023-10-05 07:00:33,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a 2023-10-05 07:00:33,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5 2023-10-05 07:00:33,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a 2023-10-05 07:00:33,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e1bcb1c0135408ff7bcfe44e6d7b4ba5 2023-10-05 07:00:33,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ae10d553a7687c80c98eab07edc4953a 2023-10-05 07:00:33,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:00:33,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e1bcb1c0135408ff7bcfe44e6d7b4ba5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60584279, jitterRate=-0.09722389280796051}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:00:33,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e1bcb1c0135408ff7bcfe44e6d7b4ba5: 2023-10-05 07:00:33,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:00:33,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5., pid=31, masterSystemTime=1696489233559 2023-10-05 07:00:33,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ae10d553a7687c80c98eab07edc4953a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61659824, jitterRate=-0.08119702339172363}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:00:33,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ae10d553a7687c80c98eab07edc4953a: 2023-10-05 07:00:33,593 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a., pid=30, masterSystemTime=1696489233559 2023-10-05 07:00:33,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:33,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:33,595 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=e1bcb1c0135408ff7bcfe44e6d7b4ba5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:33,595 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696489233594"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489233594"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489233594"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489233594"}]},"ts":"1696489233594"} 2023-10-05 07:00:33,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. 2023-10-05 07:00:33,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. 2023-10-05 07:00:33,595 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ae10d553a7687c80c98eab07edc4953a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:33,597 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696489233595"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489233595"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489233595"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489233595"}]},"ts":"1696489233595"} 2023-10-05 07:00:33,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-10-05 07:00:33,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure e1bcb1c0135408ff7bcfe44e6d7b4ba5, server=jenkins-hbase4.apache.org,33577,1696489207986 in 192 msec 2023-10-05 07:00:33,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-10-05 07:00:33,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure ae10d553a7687c80c98eab07edc4953a, server=jenkins-hbase4.apache.org,35011,1696489207914 in 194 msec 2023-10-05 07:00:33,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e1bcb1c0135408ff7bcfe44e6d7b4ba5, ASSIGN in 357 msec 2023-10-05 07:00:33,607 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-10-05 07:00:33,607 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ae10d553a7687c80c98eab07edc4953a, ASSIGN in 360 msec 2023-10-05 07:00:33,608 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 07:00:33,608 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489233608"}]},"ts":"1696489233608"} 2023-10-05 07:00:33,610 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-10-05 07:00:33,612 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 07:00:33,612 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-10-05 07:00:33,615 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39927] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 07:00:33,616 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:33,617 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:33,617 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:33,616 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:33,618 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 07:00:33,618 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 07:00:33,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 07:00:33,619 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 07:00:33,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 462 msec 2023-10-05 07:00:33,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-05 07:00:33,768 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-10-05 07:00:33,771 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-05 07:00:33,771 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:33,773 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 07:00:33,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 07:00:33,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696489233789 (current time:1696489233789). 2023-10-05 07:00:33,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 07:00:33,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x5f9a04d7 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:33,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11e55c4f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:33,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:33,801 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:33,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f9a04d7 to 127.0.0.1:58805 2023-10-05 07:00:33,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:00:33,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x2930cf52 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:33,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2603ca1f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:33,814 DEBUG [hconnection-0x1dbffdb4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:33,818 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:33,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:33,826 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:33,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2930cf52 to 127.0.0.1:58805 2023-10-05 07:00:33,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:00:33,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 07:00:33,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 07:00:33,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 07:00:33,833 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot, current working dir path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 07:00:33,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 07:00:33,836 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 07:00:33,837 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696489833837 2023-10-05 07:00:33,837 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-05 07:00:33,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 07:00:33,839 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 07:00:33,839 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 07:00:33,839 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 07:00:33,840 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 07:00:33,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-10-05 07:00:33,843 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 07:00:33,844 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696489833844 2023-10-05 07:00:33,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,860 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-10-05 07:00:33,860 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:33,862 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-10-05 07:00:33,862 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-05 07:00:33,862 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,862 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,868 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:33,868 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:33,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:33,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:33,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:33,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:33,868 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:33,868 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:33,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:33,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:33,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,868 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:33,868 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:33,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,869 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:33,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 07:00:33,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 07:00:33,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,869 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 07:00:33,869 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 07:00:33,869 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 07:00:33,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-10-05 07:00:33,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,870 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 07:00:33,870 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:33,870 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 07:00:33,871 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 07:00:33,871 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 07:00:33,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,871 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 07:00:33,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,871 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 07:00:33,871 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:33,871 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 07:00:33,873 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 07:00:33,873 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:33,873 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 07:00:33,874 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 07:00:33,874 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 07:00:33,874 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-10-05 07:00:33,874 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-10-05 07:00:33,875 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:33,875 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:33,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:33,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:33,885 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,885 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,885 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:33,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:33,885 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,885 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:33,886 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,886 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:33,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:33,886 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,886 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:33,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:33,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:33,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:33,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:33,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-05 07:00:33,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d67f5af[Count = 1] remaining members to acquire global barrier 2023-10-05 07:00:33,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:33,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:33,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:33,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:33,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:33,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:33,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:33,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:33,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:33,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-10-05 07:00:33,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d67f5af[Count = 0] remaining members to acquire global barrier 2023-10-05 07:00:33,890 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 07:00:33,891 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,892 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,892 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,892 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,892 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:33,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,892 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 07:00:33,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,892 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 07:00:33,893 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 07:00:33,893 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:33,893 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:00:33,893 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:00:33,893 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:33,893 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 07:00:33,893 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. started... 2023-10-05 07:00:33,893 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 07:00:33,893 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39927,1696489208029' in zk 2023-10-05 07:00:33,893 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. 2023-10-05 07:00:33,893 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:00:33,893 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:00:33,893 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e1bcb1c0135408ff7bcfe44e6d7b4ba5: 2023-10-05 07:00:33,893 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. started... 2023-10-05 07:00:33,895 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ae10d553a7687c80c98eab07edc4953a: 2023-10-05 07:00:33,895 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,895 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,895 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:00:33,895 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:00:33,895 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 07:00:33,895 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 07:00:33,896 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 07:00:33,896 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:33,896 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 07:00:33,913 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. completed. 2023-10-05 07:00:33,913 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. 2023-10-05 07:00:33,913 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:00:33,913 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:00:33,913 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:33,913 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 07:00:33,913 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35011,1696489207914' in zk 2023-10-05 07:00:33,915 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:33,915 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 07:00:33,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:33,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:33,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:33,915 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:33,915 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 07:00:33,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:33,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:33,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:33,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:33,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:33,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:33,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:33,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:33,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:33,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35011,1696489207914': 2023-10-05 07:00:33,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 07:00:33,939 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:00:33,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 07:00:33,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 07:00:33,941 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 07:00:33,978 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-10-05 07:00:34,141 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:00:34,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 07:00:34,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 07:00:34,142 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-05 07:00:34,313 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. completed. 2023-10-05 07:00:34,314 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:34,314 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:00:34,314 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:00:34,314 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,314 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-10-05 07:00:34,314 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33577,1696489207986' in zk 2023-10-05 07:00:34,316 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 07:00:34,316 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,316 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:34,317 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-10-05 07:00:34,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:34,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:34,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:34,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:34,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:34,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33577,1696489207986': 2023-10-05 07:00:34,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 07:00:34,323 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-10-05 07:00:34,323 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 07:00:34,323 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 07:00:34,323 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,323 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 07:00:34,325 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,325 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,325 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:34,325 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,325 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,325 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,326 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:34,325 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:34,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:34,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,326 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,327 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:34,329 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,330 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,330 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,334 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,334 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,334 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,334 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,334 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:34,334 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:34,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:34,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:34,334 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:34,334 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,334 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:34,334 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:34,334 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,334 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:34,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:34,334 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:34,334 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:34,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:34,335 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-05 07:00:34,334 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,337 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:34,337 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,337 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:34,337 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 07:00:34,337 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:34,337 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:34,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:34,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:34,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 07:00:34,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,373 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-05 07:00:34,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,374 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:34,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696489233837Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696489234349 (+512 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1696489234349Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1696489234350 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1696489234356 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1696489234365 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696489234373 (+8 ms) 2023-10-05 07:00:34,377 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 07:00:34,379 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 539 msec 2023-10-05 07:00:34,443 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:00:34,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 07:00:34,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 07:00:34,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33577] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 07:00:34,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35011] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 07:00:34,455 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-10-05 07:00:34,455 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:34,456 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 07:00:34,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 07:00:34,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696489234469 (current time:1696489234469). 2023-10-05 07:00:34,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 07:00:34,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x3232092d to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:34,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@242a533c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:34,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:34,492 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:34,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3232092d to 127.0.0.1:58805 2023-10-05 07:00:34,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:00:34,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x5042ef5b to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:34,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dee1c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:34,502 DEBUG [hconnection-0x36606651-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:34,503 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:34,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:34,511 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:34,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5042ef5b to 127.0.0.1:58805 2023-10-05 07:00:34,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:00:34,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 07:00:34,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 07:00:34,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 07:00:34,517 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot, current working dir path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 07:00:34,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 07:00:34,520 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 07:00:34,521 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696489834521 2023-10-05 07:00:34,521 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-10-05 07:00:34,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 07:00:34,523 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 07:00:34,523 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 07:00:34,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 07:00:34,524 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-10-05 07:00:34,526 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-10-05 07:00:34,526 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 07:00:34,527 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696489834527 2023-10-05 07:00:34,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-10-05 07:00:34,541 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-10-05 07:00:34,541 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:34,543 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-10-05 07:00:34,543 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-10-05 07:00:34,544 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,544 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,545 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:34,545 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:34,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:34,545 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:34,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:34,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:34,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:34,545 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:34,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:34,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,546 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,546 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,546 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,546 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 07:00:34,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 07:00:34,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,547 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 07:00:34,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,547 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 07:00:34,547 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 07:00:34,547 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:34,548 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 07:00:34,548 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 07:00:34,549 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 07:00:34,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 07:00:34,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-10-05 07:00:34,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,549 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 07:00:34,549 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-10-05 07:00:34,549 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 07:00:34,549 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-10-05 07:00:34,549 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 07:00:34,549 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-10-05 07:00:34,549 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:34,549 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:34,550 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 07:00:34,550 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 07:00:34,551 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 07:00:34,551 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-10-05 07:00:34,551 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-10-05 07:00:34,551 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-10-05 07:00:34,552 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,552 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:34,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:34,552 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,552 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:34,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:34,553 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:34,555 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,555 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:34,555 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 07:00:34,556 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,556 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:34,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:34,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-05 07:00:34,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e2da0c0[Count = 1] remaining members to acquire global barrier 2023-10-05 07:00:34,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:34,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:34,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:34,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:34,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 07:00:34,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:34,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-10-05 07:00:34,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e2da0c0[Count = 0] remaining members to acquire global barrier 2023-10-05 07:00:34,559 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 07:00:34,560 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,561 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,561 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,561 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,561 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 07:00:34,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,561 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,561 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 07:00:34,562 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-10-05 07:00:34,562 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 07:00:34,562 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39927,1696489208029' in zk 2023-10-05 07:00:34,562 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:00:34,562 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,562 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 07:00:34,562 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. 2023-10-05 07:00:34,562 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:00:34,562 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:34,562 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. started... 2023-10-05 07:00:34,562 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:00:34,562 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:00:34,562 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. started... 2023-10-05 07:00:34,562 INFO [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ae10d553a7687c80c98eab07edc4953a 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-05 07:00:34,562 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e1bcb1c0135408ff7bcfe44e6d7b4ba5 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-05 07:00:34,565 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 07:00:34,565 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:34,565 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 07:00:34,623 INFO [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231005c55cf26d84e4443e8d3c6d8aa47db345 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231005c55cf26d84e4443e8d3c6d8aa47db345 2023-10-05 07:00:34,623 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:00:34,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 07:00:34,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 07:00:34,632 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 07:00:34,634 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310052618809974a840669a3ba0afae1824ee to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310052618809974a840669a3ba0afae1824ee 2023-10-05 07:00:34,647 INFO [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a/.tmp/cf/e9b130e48d6740a5938f43809415eabf 2023-10-05 07:00:34,655 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5/.tmp/cf/8c0164c7b2364880a0b4540e1d60848d 2023-10-05 07:00:34,656 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a/.tmp/cf/e9b130e48d6740a5938f43809415eabf as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a/cf/e9b130e48d6740a5938f43809415eabf 2023-10-05 07:00:34,663 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5/.tmp/cf/8c0164c7b2364880a0b4540e1d60848d as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5/cf/8c0164c7b2364880a0b4540e1d60848d 2023-10-05 07:00:34,664 INFO [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a/cf/e9b130e48d6740a5938f43809415eabf, entries=46, sequenceid=6, filesize=12.7 K 2023-10-05 07:00:34,665 INFO [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for ae10d553a7687c80c98eab07edc4953a in 103ms, sequenceid=6, compaction requested=false 2023-10-05 07:00:34,667 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ae10d553a7687c80c98eab07edc4953a: 2023-10-05 07:00:34,667 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 07:00:34,667 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:00:34,667 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a/cf/e9b130e48d6740a5938f43809415eabf] hfiles 2023-10-05 07:00:34,667 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a/cf/e9b130e48d6740a5938f43809415eabf for snapshot=snaptb0-testExportFileSystemState 2023-10-05 07:00:34,672 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5/cf/8c0164c7b2364880a0b4540e1d60848d, entries=4, sequenceid=6, filesize=5.6 K 2023-10-05 07:00:34,673 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for e1bcb1c0135408ff7bcfe44e6d7b4ba5 in 111ms, sequenceid=6, compaction requested=false 2023-10-05 07:00:34,673 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e1bcb1c0135408ff7bcfe44e6d7b4ba5: 2023-10-05 07:00:34,673 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 07:00:34,673 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:00:34,673 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5/cf/8c0164c7b2364880a0b4540e1d60848d] hfiles 2023-10-05 07:00:34,673 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5/cf/8c0164c7b2364880a0b4540e1d60848d for snapshot=snaptb0-testExportFileSystemState 2023-10-05 07:00:34,681 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. completed. 2023-10-05 07:00:34,681 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. 2023-10-05 07:00:34,681 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:00:34,682 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:00:34,682 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,682 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 07:00:34,682 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35011,1696489207914' in zk 2023-10-05 07:00:34,687 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 07:00:34,687 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,687 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:34,687 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 07:00:34,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:34,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:34,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:34,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 07:00:34,690 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. completed. 2023-10-05 07:00:34,690 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:34,691 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:00:34,691 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:00:34,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,691 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,691 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-10-05 07:00:34,691 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33577,1696489207986' in zk 2023-10-05 07:00:34,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,707 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,707 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-10-05 07:00:34,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:34,715 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:34,715 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-10-05 07:00:34,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 07:00:34,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35011,1696489207914': 2023-10-05 07:00:34,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 07:00:34,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:34,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:34,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:34,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:34,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 07:00:34,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:34,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 07:00:34,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33577,1696489207986': 2023-10-05 07:00:34,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 07:00:34,722 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-10-05 07:00:34,723 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 07:00:34,723 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 07:00:34,723 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-10-05 07:00:34,723 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 07:00:34,725 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,725 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:34,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,725 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,725 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:34,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,725 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,726 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:34,726 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:34,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:34,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:34,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:34,726 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 07:00:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,727 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:34,727 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 07:00:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:34,729 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-10-05 07:00:34,730 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,730 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,734 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,734 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,734 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,734 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:34,734 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,734 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:34,734 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:34,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:34,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:34,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:34,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:34,734 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,734 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:34,734 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:34,734 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:34,734 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-10-05 07:00:34,735 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-10-05 07:00:34,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-10-05 07:00:34,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 07:00:34,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:34,734 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:34,734 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:34,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:34,735 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,735 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:34,736 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:34,736 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,736 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231005c55cf26d84e4443e8d3c6d8aa47db345, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310052618809974a840669a3ba0afae1824ee] mob files 2023-10-05 07:00:34,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231005c55cf26d84e4443e8d3c6d8aa47db345 2023-10-05 07:00:34,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310052618809974a840669a3ba0afae1824ee 2023-10-05 07:00:34,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:34,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:34,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-10-05 07:00:34,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,806 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-10-05 07:00:34,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,807 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1696489234522Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1696489234760 (+238 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1696489234760Loading Region manifests for snaptb0-testExportFileSystemState at 1696489234760Writing data manifest for snaptb0-testExportFileSystemState at 1696489234772 (+12 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1696489234793 (+21 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1696489234806 (+13 ms) 2023-10-05 07:00:34,810 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-10-05 07:00:34,812 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 288 msec 2023-10-05 07:00:34,832 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:00:34,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 07:00:34,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 07:00:34,834 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489234834 2023-10-05 07:00:34,835 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41859, tgtDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489234834, rawTgtDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489234834, srcFsUri=hdfs://localhost:41859, srcDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:00:34,864 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41859, inputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:00:34,864 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1844648960_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489234834, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489234834/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,864 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41859, inputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0, snapshotDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-10-05 07:00:34,880 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489234834/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-10-05 07:00:34,910 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:34,910 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:34,911 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:34,911 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:35,805 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop-2123263811251400615.jar 2023-10-05 07:00:35,806 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:35,806 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:35,875 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop-5461811062244714106.jar 2023-10-05 07:00:35,875 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:35,875 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:35,876 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:35,876 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:35,877 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:35,877 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:35,877 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 07:00:35,878 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 07:00:35,878 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 07:00:35,879 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 07:00:35,879 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 07:00:35,880 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 07:00:35,881 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 07:00:35,882 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 07:00:35,882 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 07:00:35,883 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 07:00:35,884 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:00:35,885 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:00:35,885 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:00:35,886 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:00:35,886 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:00:35,887 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:00:35,888 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:00:36,360 WARN [Listener at jenkins-hbase4.apache.org/36167] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 07:00:36,362 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-10-05 07:00:36,364 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-10-05 07:00:37,170 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 07:00:37,170 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 07:00:37,176 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0001_000001 (auth:SIMPLE) 2023-10-05 07:00:37,719 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0002_000001 (auth:SIMPLE) 2023-10-05 07:00:38,458 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 07:00:41,953 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0002_000001 (auth:SIMPLE) 2023-10-05 07:00:44,183 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0002_000001 (auth:SIMPLE) 2023-10-05 07:00:47,380 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0002_000001 (auth:SIMPLE) 2023-10-05 07:00:48,568 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 07:00:48,569 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 07:00:48,578 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-10-05 07:00:48,578 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 07:00:48,578 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 07:00:48,579 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740582836_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 07:00:48,579 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-05 07:00:48,579 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-05 07:00:48,579 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740582836_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489234834/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489234834/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-10-05 07:00:48,580 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489234834/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-10-05 07:00:48,580 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489234834/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-10-05 07:00:48,587 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-10-05 07:00:48,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-10-05 07:00:48,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-10-05 07:00:48,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 07:00:48,593 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489248593"}]},"ts":"1696489248593"} 2023-10-05 07:00:48,594 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-10-05 07:00:48,597 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-10-05 07:00:48,597 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e1bcb1c0135408ff7bcfe44e6d7b4ba5, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ae10d553a7687c80c98eab07edc4953a, UNASSIGN}] 2023-10-05 07:00:48,600 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ae10d553a7687c80c98eab07edc4953a, UNASSIGN 2023-10-05 07:00:48,600 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e1bcb1c0135408ff7bcfe44e6d7b4ba5, UNASSIGN 2023-10-05 07:00:48,601 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ae10d553a7687c80c98eab07edc4953a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:48,601 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696489248601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489248601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489248601"}]},"ts":"1696489248601"} 2023-10-05 07:00:48,601 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=e1bcb1c0135408ff7bcfe44e6d7b4ba5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:48,601 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696489248601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489248601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489248601"}]},"ts":"1696489248601"} 2023-10-05 07:00:48,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure ae10d553a7687c80c98eab07edc4953a, server=jenkins-hbase4.apache.org,35011,1696489207914}] 2023-10-05 07:00:48,603 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure e1bcb1c0135408ff7bcfe44e6d7b4ba5, server=jenkins-hbase4.apache.org,33577,1696489207986}] 2023-10-05 07:00:48,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 07:00:48,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ae10d553a7687c80c98eab07edc4953a 2023-10-05 07:00:48,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ae10d553a7687c80c98eab07edc4953a, disabling compactions & flushes 2023-10-05 07:00:48,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. 2023-10-05 07:00:48,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. 2023-10-05 07:00:48,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. after waiting 0 ms 2023-10-05 07:00:48,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. 2023-10-05 07:00:48,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e1bcb1c0135408ff7bcfe44e6d7b4ba5 2023-10-05 07:00:48,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e1bcb1c0135408ff7bcfe44e6d7b4ba5, disabling compactions & flushes 2023-10-05 07:00:48,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:48,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:48,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. after waiting 0 ms 2023-10-05 07:00:48,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:48,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 07:00:48,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 07:00:48,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:00:48,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:00:48,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a. 2023-10-05 07:00:48,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5. 2023-10-05 07:00:48,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ae10d553a7687c80c98eab07edc4953a: 2023-10-05 07:00:48,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e1bcb1c0135408ff7bcfe44e6d7b4ba5: 2023-10-05 07:00:48,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ae10d553a7687c80c98eab07edc4953a 2023-10-05 07:00:48,771 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ae10d553a7687c80c98eab07edc4953a, regionState=CLOSED 2023-10-05 07:00:48,771 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696489248771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489248771"}]},"ts":"1696489248771"} 2023-10-05 07:00:48,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e1bcb1c0135408ff7bcfe44e6d7b4ba5 2023-10-05 07:00:48,772 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=e1bcb1c0135408ff7bcfe44e6d7b4ba5, regionState=CLOSED 2023-10-05 07:00:48,772 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1696489248772"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489248772"}]},"ts":"1696489248772"} 2023-10-05 07:00:48,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-10-05 07:00:48,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure ae10d553a7687c80c98eab07edc4953a, server=jenkins-hbase4.apache.org,35011,1696489207914 in 171 msec 2023-10-05 07:00:48,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-10-05 07:00:48,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure e1bcb1c0135408ff7bcfe44e6d7b4ba5, server=jenkins-hbase4.apache.org,33577,1696489207986 in 171 msec 2023-10-05 07:00:48,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ae10d553a7687c80c98eab07edc4953a, UNASSIGN in 178 msec 2023-10-05 07:00:48,778 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-05 07:00:48,778 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e1bcb1c0135408ff7bcfe44e6d7b4ba5, UNASSIGN in 179 msec 2023-10-05 07:00:48,779 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489248779"}]},"ts":"1696489248779"} 2023-10-05 07:00:48,781 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-10-05 07:00:48,782 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-10-05 07:00:48,785 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 195 msec 2023-10-05 07:00:48,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-10-05 07:00:48,895 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-10-05 07:00:48,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-10-05 07:00:48,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 07:00:48,899 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 07:00:48,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-10-05 07:00:48,900 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 07:00:48,902 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39927] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-10-05 07:00:48,905 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5 2023-10-05 07:00:48,905 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a 2023-10-05 07:00:48,906 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 07:00:48,906 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 07:00:48,906 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 07:00:48,906 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 07:00:48,907 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 07:00:48,907 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 07:00:48,907 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 07:00:48,907 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-10-05 07:00:48,908 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 07:00:48,908 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:48,908 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 07:00:48,908 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:48,908 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 07:00:48,908 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:48,908 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-10-05 07:00:48,908 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:48,909 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5/cf, FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5/recovered.edits] 2023-10-05 07:00:48,909 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a/cf, FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a/recovered.edits] 2023-10-05 07:00:48,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-05 07:00:48,914 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5/cf/8c0164c7b2364880a0b4540e1d60848d to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5/cf/8c0164c7b2364880a0b4540e1d60848d 2023-10-05 07:00:48,914 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a/cf/e9b130e48d6740a5938f43809415eabf to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a/cf/e9b130e48d6740a5938f43809415eabf 2023-10-05 07:00:48,918 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5/recovered.edits/9.seqid to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5/recovered.edits/9.seqid 2023-10-05 07:00:48,918 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a/recovered.edits/9.seqid to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a/recovered.edits/9.seqid 2023-10-05 07:00:48,918 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/e1bcb1c0135408ff7bcfe44e6d7b4ba5 2023-10-05 07:00:48,919 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemState/ae10d553a7687c80c98eab07edc4953a 2023-10-05 07:00:48,919 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-10-05 07:00:48,919 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-05 07:00:48,920 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-10-05 07:00:48,924 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231005c55cf26d84e4443e8d3c6d8aa47db345 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20231005c55cf26d84e4443e8d3c6d8aa47db345 2023-10-05 07:00:48,926 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310052618809974a840669a3ba0afae1824ee to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202310052618809974a840669a3ba0afae1824ee 2023-10-05 07:00:48,926 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-10-05 07:00:48,929 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 07:00:48,932 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-10-05 07:00:48,934 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-10-05 07:00:48,936 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 07:00:48,936 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-10-05 07:00:48,936 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696489248936"}]},"ts":"9223372036854775807"} 2023-10-05 07:00:48,936 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696489248936"}]},"ts":"9223372036854775807"} 2023-10-05 07:00:48,938 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 07:00:48,938 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e1bcb1c0135408ff7bcfe44e6d7b4ba5, NAME => 'testtb-testExportFileSystemState,,1696489233154.e1bcb1c0135408ff7bcfe44e6d7b4ba5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ae10d553a7687c80c98eab07edc4953a, NAME => 'testtb-testExportFileSystemState,1,1696489233154.ae10d553a7687c80c98eab07edc4953a.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 07:00:48,938 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-10-05 07:00:48,939 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696489248938"}]},"ts":"9223372036854775807"} 2023-10-05 07:00:48,940 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-10-05 07:00:48,943 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-10-05 07:00:48,945 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 47 msec 2023-10-05 07:00:49,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-10-05 07:00:49,012 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-10-05 07:00:49,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-10-05 07:00:49,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-10-05 07:00:49,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-10-05 07:00:49,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemState 2023-10-05 07:00:49,055 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=766 (was 755) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:36167 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740582836_17 at /127.0.0.1:44190 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:38003 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740582836_17 at /127.0.0.1:51326 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1964 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_652381869_1 at /127.0.0.1:41486 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_652381869_1 at /127.0.0.1:44182 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740582836_17 at /127.0.0.1:41508 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=941 (was 923) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=338 (was 311) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=5956 (was 6111) 2023-10-05 07:00:49,055 WARN [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-10-05 07:00:49,078 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=941, MaxFileDescriptor=60000, SystemLoadAverage=338, ProcessCount=168, AvailableMemoryMB=5955 2023-10-05 07:00:49,078 WARN [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-10-05 07:00:49,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 07:00:49,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-10-05 07:00:49,084 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 07:00:49,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-10-05 07:00:49,085 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 07:00:49,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 07:00:49,087 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d 2023-10-05 07:00:49,087 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa 2023-10-05 07:00:49,088 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa empty. 2023-10-05 07:00:49,088 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d empty. 2023-10-05 07:00:49,089 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa 2023-10-05 07:00:49,089 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d 2023-10-05 07:00:49,089 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-05 07:00:49,101 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-10-05 07:00:49,103 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 77f8c2f6fd693262cb3fe32d879b329d, NAME => 'testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp 2023-10-05 07:00:49,103 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => f369dbebd76c07cbb3a5a10a77b20bfa, NAME => 'testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp 2023-10-05 07:00:49,123 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:49,123 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing f369dbebd76c07cbb3a5a10a77b20bfa, disabling compactions & flushes 2023-10-05 07:00:49,123 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. 2023-10-05 07:00:49,124 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. 2023-10-05 07:00:49,124 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. after waiting 0 ms 2023-10-05 07:00:49,124 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. 2023-10-05 07:00:49,124 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. 2023-10-05 07:00:49,124 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for f369dbebd76c07cbb3a5a10a77b20bfa: 2023-10-05 07:00:49,126 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:49,126 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 77f8c2f6fd693262cb3fe32d879b329d, disabling compactions & flushes 2023-10-05 07:00:49,126 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:00:49,126 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:00:49,126 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. after waiting 0 ms 2023-10-05 07:00:49,126 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:00:49,126 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:00:49,126 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 77f8c2f6fd693262cb3fe32d879b329d: 2023-10-05 07:00:49,129 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 07:00:49,130 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696489249129"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489249129"}]},"ts":"1696489249129"} 2023-10-05 07:00:49,130 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696489249129"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489249129"}]},"ts":"1696489249129"} 2023-10-05 07:00:49,132 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 07:00:49,134 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 07:00:49,134 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489249134"}]},"ts":"1696489249134"} 2023-10-05 07:00:49,136 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-10-05 07:00:49,140 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 07:00:49,142 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 07:00:49,142 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 07:00:49,142 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 07:00:49,142 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 07:00:49,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=77f8c2f6fd693262cb3fe32d879b329d, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f369dbebd76c07cbb3a5a10a77b20bfa, ASSIGN}] 2023-10-05 07:00:49,145 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=77f8c2f6fd693262cb3fe32d879b329d, ASSIGN 2023-10-05 07:00:49,145 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f369dbebd76c07cbb3a5a10a77b20bfa, ASSIGN 2023-10-05 07:00:49,146 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=77f8c2f6fd693262cb3fe32d879b329d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35011,1696489207914; forceNewPlan=false, retain=false 2023-10-05 07:00:49,146 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f369dbebd76c07cbb3a5a10a77b20bfa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33577,1696489207986; forceNewPlan=false, retain=false 2023-10-05 07:00:49,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 07:00:49,297 INFO [jenkins-hbase4:33507] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 07:00:49,299 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=77f8c2f6fd693262cb3fe32d879b329d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,299 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=f369dbebd76c07cbb3a5a10a77b20bfa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,299 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696489249299"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489249299"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489249299"}]},"ts":"1696489249299"} 2023-10-05 07:00:49,300 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696489249299"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489249299"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489249299"}]},"ts":"1696489249299"} 2023-10-05 07:00:49,302 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 77f8c2f6fd693262cb3fe32d879b329d, server=jenkins-hbase4.apache.org,35011,1696489207914}] 2023-10-05 07:00:49,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure f369dbebd76c07cbb3a5a10a77b20bfa, server=jenkins-hbase4.apache.org,33577,1696489207986}] 2023-10-05 07:00:49,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 07:00:49,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:00:49,457 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. 2023-10-05 07:00:49,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 77f8c2f6fd693262cb3fe32d879b329d, NAME => 'testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 07:00:49,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f369dbebd76c07cbb3a5a10a77b20bfa, NAME => 'testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 07:00:49,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. service=AccessControlService 2023-10-05 07:00:49,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. service=AccessControlService 2023-10-05 07:00:49,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:00:49,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports f369dbebd76c07cbb3a5a10a77b20bfa 2023-10-05 07:00:49,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:00:49,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:49,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 77f8c2f6fd693262cb3fe32d879b329d 2023-10-05 07:00:49,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f369dbebd76c07cbb3a5a10a77b20bfa 2023-10-05 07:00:49,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:00:49,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f369dbebd76c07cbb3a5a10a77b20bfa 2023-10-05 07:00:49,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 77f8c2f6fd693262cb3fe32d879b329d 2023-10-05 07:00:49,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 77f8c2f6fd693262cb3fe32d879b329d 2023-10-05 07:00:49,460 INFO [StoreOpener-f369dbebd76c07cbb3a5a10a77b20bfa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f369dbebd76c07cbb3a5a10a77b20bfa 2023-10-05 07:00:49,460 INFO [StoreOpener-77f8c2f6fd693262cb3fe32d879b329d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 77f8c2f6fd693262cb3fe32d879b329d 2023-10-05 07:00:49,461 DEBUG [StoreOpener-f369dbebd76c07cbb3a5a10a77b20bfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa/cf 2023-10-05 07:00:49,461 DEBUG [StoreOpener-f369dbebd76c07cbb3a5a10a77b20bfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa/cf 2023-10-05 07:00:49,461 DEBUG [StoreOpener-77f8c2f6fd693262cb3fe32d879b329d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d/cf 2023-10-05 07:00:49,462 DEBUG [StoreOpener-77f8c2f6fd693262cb3fe32d879b329d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d/cf 2023-10-05 07:00:49,462 INFO [StoreOpener-f369dbebd76c07cbb3a5a10a77b20bfa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f369dbebd76c07cbb3a5a10a77b20bfa columnFamilyName cf 2023-10-05 07:00:49,462 INFO [StoreOpener-77f8c2f6fd693262cb3fe32d879b329d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77f8c2f6fd693262cb3fe32d879b329d columnFamilyName cf 2023-10-05 07:00:49,463 INFO [StoreOpener-f369dbebd76c07cbb3a5a10a77b20bfa-1] regionserver.HStore(310): Store=f369dbebd76c07cbb3a5a10a77b20bfa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:00:49,463 INFO [StoreOpener-77f8c2f6fd693262cb3fe32d879b329d-1] regionserver.HStore(310): Store=77f8c2f6fd693262cb3fe32d879b329d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:00:49,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d 2023-10-05 07:00:49,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa 2023-10-05 07:00:49,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d 2023-10-05 07:00:49,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa 2023-10-05 07:00:49,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f369dbebd76c07cbb3a5a10a77b20bfa 2023-10-05 07:00:49,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 77f8c2f6fd693262cb3fe32d879b329d 2023-10-05 07:00:49,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:00:49,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:00:49,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 77f8c2f6fd693262cb3fe32d879b329d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73625033, jitterRate=0.09709848463535309}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:00:49,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 77f8c2f6fd693262cb3fe32d879b329d: 2023-10-05 07:00:49,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f369dbebd76c07cbb3a5a10a77b20bfa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65065277, jitterRate=-0.03045181930065155}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:00:49,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f369dbebd76c07cbb3a5a10a77b20bfa: 2023-10-05 07:00:49,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d., pid=45, masterSystemTime=1696489249453 2023-10-05 07:00:49,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa., pid=46, masterSystemTime=1696489249455 2023-10-05 07:00:49,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:00:49,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:00:49,475 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=77f8c2f6fd693262cb3fe32d879b329d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,475 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696489249474"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489249474"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489249474"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489249474"}]},"ts":"1696489249474"} 2023-10-05 07:00:49,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. 2023-10-05 07:00:49,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. 2023-10-05 07:00:49,476 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=f369dbebd76c07cbb3a5a10a77b20bfa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,476 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696489249476"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489249476"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489249476"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489249476"}]},"ts":"1696489249476"} 2023-10-05 07:00:49,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-10-05 07:00:49,479 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 77f8c2f6fd693262cb3fe32d879b329d, server=jenkins-hbase4.apache.org,35011,1696489207914 in 175 msec 2023-10-05 07:00:49,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-10-05 07:00:49,480 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=77f8c2f6fd693262cb3fe32d879b329d, ASSIGN in 337 msec 2023-10-05 07:00:49,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure f369dbebd76c07cbb3a5a10a77b20bfa, server=jenkins-hbase4.apache.org,33577,1696489207986 in 176 msec 2023-10-05 07:00:49,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-10-05 07:00:49,482 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f369dbebd76c07cbb3a5a10a77b20bfa, ASSIGN in 338 msec 2023-10-05 07:00:49,483 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 07:00:49,483 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489249483"}]},"ts":"1696489249483"} 2023-10-05 07:00:49,485 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-10-05 07:00:49,487 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 07:00:49,487 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-10-05 07:00:49,490 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39927] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 07:00:49,491 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:49,491 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:49,491 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:49,491 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:00:49,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 07:00:49,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 07:00:49,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 07:00:49,493 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-10-05 07:00:49,495 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 413 msec 2023-10-05 07:00:49,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-10-05 07:00:49,689 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-10-05 07:00:49,692 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-05 07:00:49,692 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:00:49,695 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 07:00:49,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 07:00:49,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696489249706 (current time:1696489249706). 2023-10-05 07:00:49,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 07:00:49,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x7e664d33 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:49,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b5644a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:49,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:49,720 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:49,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e664d33 to 127.0.0.1:58805 2023-10-05 07:00:49,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:00:49,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x3bb1d049 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:49,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77f20dd9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:49,729 DEBUG [hconnection-0x1ee81cee-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:49,732 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:49,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:49,737 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:49,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bb1d049 to 127.0.0.1:58805 2023-10-05 07:00:49,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:00:49,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 07:00:49,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 07:00:49,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 07:00:49,742 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot, current working dir path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 07:00:49,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 07:00:49,744 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 07:00:49,745 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696489849745 2023-10-05 07:00:49,745 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-05 07:00:49,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 07:00:49,746 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 07:00:49,747 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 07:00:49,748 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 07:00:49,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 07:00:49,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-10-05 07:00:49,750 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 07:00:49,750 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696489849750 2023-10-05 07:00:49,761 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,762 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-10-05 07:00:49,762 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:49,763 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-10-05 07:00:49,763 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-05 07:00:49,763 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,764 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,766 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:49,766 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:49,766 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:49,766 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:49,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:49,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:49,766 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,766 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,767 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,767 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 07:00:49,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 07:00:49,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 07:00:49,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,767 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 07:00:49,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-10-05 07:00:49,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,767 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 07:00:49,767 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,768 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 07:00:49,768 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 07:00:49,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,768 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:49,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,769 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 07:00:49,769 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 07:00:49,769 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:49,768 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 07:00:49,771 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 07:00:49,771 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 07:00:49,771 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:49,769 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 07:00:49,774 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 07:00:49,774 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 07:00:49,771 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 07:00:49,774 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-10-05 07:00:49,774 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-10-05 07:00:49,776 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,776 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,776 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:49,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:49,777 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,777 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:49,777 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,777 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,777 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:49,777 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:49,777 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:49,777 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:49,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:49,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:49,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-05 07:00:49,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36da361c[Count = 1] remaining members to acquire global barrier 2023-10-05 07:00:49,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:49,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:49,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:49,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:49,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:49,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:49,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-10-05 07:00:49,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36da361c[Count = 0] remaining members to acquire global barrier 2023-10-05 07:00:49,781 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-05 07:00:49,781 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,782 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,782 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,782 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,783 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 07:00:49,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,783 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,783 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:00:49,783 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 07:00:49,783 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 07:00:49,783 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 07:00:49,783 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39927,1696489208029' in zk 2023-10-05 07:00:49,783 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:00:49,783 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,783 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 07:00:49,783 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:00:49,783 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. 2023-10-05 07:00:49,783 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:00:49,783 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. started... 2023-10-05 07:00:49,783 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. started... 2023-10-05 07:00:49,783 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:00:49,785 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f369dbebd76c07cbb3a5a10a77b20bfa: 2023-10-05 07:00:49,785 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 77f8c2f6fd693262cb3fe32d879b329d: 2023-10-05 07:00:49,785 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,785 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,785 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:00:49,785 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:00:49,785 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 07:00:49,785 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 07:00:49,796 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 07:00:49,796 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:49,796 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 07:00:49,803 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. completed. 2023-10-05 07:00:49,803 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:00:49,803 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:00:49,803 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:00:49,803 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,803 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 07:00:49,803 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35011,1696489207914' in zk 2023-10-05 07:00:49,805 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. completed. 2023-10-05 07:00:49,805 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. 2023-10-05 07:00:49,805 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:00:49,805 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 07:00:49,805 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,805 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:49,805 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:00:49,806 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,805 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 07:00:49,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:49,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:49,807 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-10-05 07:00:49,807 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33577,1696489207986' in zk 2023-10-05 07:00:49,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:49,810 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,810 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 07:00:49,810 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:49,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:49,810 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-10-05 07:00:49,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:49,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:49,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:49,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35011,1696489207914': 2023-10-05 07:00:49,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-05 07:00:49,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:49,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:49,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:49,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:49,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:49,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:49,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:49,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33577,1696489207986': 2023-10-05 07:00:49,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-05 07:00:49,817 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-10-05 07:00:49,818 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 07:00:49,818 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 07:00:49,818 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,818 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 07:00:49,820 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,820 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:49,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:49,820 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:49,820 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,820 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,821 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:49,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,821 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:49,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:49,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,821 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:49,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:49,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:49,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:49,821 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:49,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,822 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:49,825 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,826 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,826 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,830 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,830 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:49,830 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:49,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:49,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:49,830 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:49,830 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:49,830 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:49,830 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,832 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:49,832 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:49,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:49,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:49,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:49,830 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:49,830 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:49,832 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-05 07:00:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:49,832 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:49,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:49,832 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,833 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:49,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:49,833 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:49,833 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 07:00:49,833 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,833 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:49,833 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:49,833 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,833 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 07:00:49,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,847 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:00:49,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 07:00:49,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-05 07:00:49,848 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 07:00:49,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,865 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-05 07:00:49,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,866 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-10-05 07:00:49,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696489249745Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696489249841 (+96 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1696489249841Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1696489249842 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1696489249845 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1696489249858 (+13 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696489249865 (+7 ms) 2023-10-05 07:00:49,871 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 07:00:49,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 125 msec 2023-10-05 07:00:50,048 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:00:50,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 07:00:50,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 07:00:50,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35011] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 07:00:50,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33577] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 07:00:50,057 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-10-05 07:00:50,057 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:00:50,057 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 07:00:50,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 07:00:50,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696489250068 (current time:1696489250068). 2023-10-05 07:00:50,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 07:00:50,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x0bd0def4 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:50,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f09beca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:50,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:50,084 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:50,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bd0def4 to 127.0.0.1:58805 2023-10-05 07:00:50,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:00:50,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x25290f7c to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:00:50,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28035253, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:00:50,094 DEBUG [hconnection-0x4a1e4677-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:50,097 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:50,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:00:50,103 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:00:50,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25290f7c to 127.0.0.1:58805 2023-10-05 07:00:50,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:00:50,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-10-05 07:00:50,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 07:00:50,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 07:00:50,108 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot, current working dir path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 07:00:50,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 07:00:50,111 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 07:00:50,111 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1696489850111 2023-10-05 07:00:50,112 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-10-05 07:00:50,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-10-05 07:00:50,113 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 07:00:50,113 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 07:00:50,114 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-10-05 07:00:50,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 07:00:50,116 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-10-05 07:00:50,117 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 07:00:50,117 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1696489850117 2023-10-05 07:00:50,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-10-05 07:00:50,130 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-10-05 07:00:50,130 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:50,132 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-10-05 07:00:50,132 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-10-05 07:00:50,132 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,132 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,134 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:50,134 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:50,134 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,134 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:50,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:50,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:50,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:50,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:50,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:50,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:50,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,135 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,135 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,135 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,135 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 07:00:50,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,135 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 07:00:50,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 07:00:50,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-10-05 07:00:50,136 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 07:00:50,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,136 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 07:00:50,136 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-10-05 07:00:50,136 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 07:00:50,136 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 07:00:50,136 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 07:00:50,136 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:50,136 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 07:00:50,136 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:50,142 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 07:00:50,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-10-05 07:00:50,142 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 07:00:50,142 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-10-05 07:00:50,142 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:00:50,142 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 07:00:50,143 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-10-05 07:00:50,143 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 07:00:50,142 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 07:00:50,143 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 07:00:50,143 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-10-05 07:00:50,143 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-10-05 07:00:50,145 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,145 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:50,146 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,146 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,146 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:50,146 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,146 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:50,146 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,146 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:50,146 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,146 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:00:50,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:50,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 07:00:50,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:50,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-05 07:00:50,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46fba5fd[Count = 1] remaining members to acquire global barrier 2023-10-05 07:00:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:50,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:50,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:50,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 07:00:50,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:50,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:50,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-10-05 07:00:50,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46fba5fd[Count = 0] remaining members to acquire global barrier 2023-10-05 07:00:50,151 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-10-05 07:00:50,151 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,157 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,157 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,157 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,158 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,158 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 07:00:50,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,158 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 07:00:50,158 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 07:00:50,158 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,158 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 07:00:50,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,158 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39927,1696489208029' in zk 2023-10-05 07:00:50,158 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-10-05 07:00:50,158 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:00:50,158 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:00:50,158 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:00:50,159 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:00:50,159 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:00:50,159 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. 2023-10-05 07:00:50,159 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. started... 2023-10-05 07:00:50,159 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. started... 2023-10-05 07:00:50,159 INFO [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 77f8c2f6fd693262cb3fe32d879b329d 1/1 column families, dataSize=132 B heapSize=544 B 2023-10-05 07:00:50,159 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f369dbebd76c07cbb3a5a10a77b20bfa 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-10-05 07:00:50,160 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 07:00:50,160 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:50,160 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 07:00:50,186 INFO [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005a0f80c934f3c4721b571b029f8171606 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005a0f80c934f3c4721b571b029f8171606 2023-10-05 07:00:50,191 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310053993ff71e7eb4541a403355fce629b59 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202310053993ff71e7eb4541a403355fce629b59 2023-10-05 07:00:50,198 INFO [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d/.tmp/cf/465edd09012f4eb98f6fdee949a5916a 2023-10-05 07:00:50,198 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa/.tmp/cf/9b7335197ff94efaa07dc5f532d075e4 2023-10-05 07:00:50,203 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d/.tmp/cf/465edd09012f4eb98f6fdee949a5916a as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d/cf/465edd09012f4eb98f6fdee949a5916a 2023-10-05 07:00:50,204 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa/.tmp/cf/9b7335197ff94efaa07dc5f532d075e4 as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa/cf/9b7335197ff94efaa07dc5f532d075e4 2023-10-05 07:00:50,208 INFO [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d/cf/465edd09012f4eb98f6fdee949a5916a, entries=2, sequenceid=6, filesize=5.2 K 2023-10-05 07:00:50,208 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa/cf/9b7335197ff94efaa07dc5f532d075e4, entries=48, sequenceid=6, filesize=12.9 K 2023-10-05 07:00:50,210 INFO [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 77f8c2f6fd693262cb3fe32d879b329d in 51ms, sequenceid=6, compaction requested=false 2023-10-05 07:00:50,210 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for f369dbebd76c07cbb3a5a10a77b20bfa in 51ms, sequenceid=6, compaction requested=false 2023-10-05 07:00:50,210 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-05 07:00:50,210 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-10-05 07:00:50,211 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 77f8c2f6fd693262cb3fe32d879b329d: 2023-10-05 07:00:50,211 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f369dbebd76c07cbb3a5a10a77b20bfa: 2023-10-05 07:00:50,212 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 07:00:50,212 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 07:00:50,212 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:00:50,212 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:00:50,212 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d/cf/465edd09012f4eb98f6fdee949a5916a] hfiles 2023-10-05 07:00:50,212 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa/cf/9b7335197ff94efaa07dc5f532d075e4] hfiles 2023-10-05 07:00:50,212 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d/cf/465edd09012f4eb98f6fdee949a5916a for snapshot=snaptb0-testConsecutiveExports 2023-10-05 07:00:50,212 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa/cf/9b7335197ff94efaa07dc5f532d075e4 for snapshot=snaptb0-testConsecutiveExports 2023-10-05 07:00:50,213 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:00:50,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 07:00:50,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-10-05 07:00:50,215 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 07:00:50,219 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. completed. 2023-10-05 07:00:50,219 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. 2023-10-05 07:00:50,219 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:00:50,219 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:00:50,219 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,219 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 07:00:50,219 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33577,1696489207986' in zk 2023-10-05 07:00:50,220 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. completed. 2023-10-05 07:00:50,220 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:00:50,220 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:00:50,220 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:00:50,220 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,220 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-10-05 07:00:50,220 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35011,1696489207914' in zk 2023-10-05 07:00:50,221 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,221 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 07:00:50,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:50,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:50,221 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:50,221 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 07:00:50,223 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-10-05 07:00:50,223 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:50,223 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:50,224 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-10-05 07:00:50,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:50,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 07:00:50,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:50,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:50,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 07:00:50,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:50,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33577,1696489207986': 2023-10-05 07:00:50,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-10-05 07:00:50,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:50,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:50,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:50,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:50,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 07:00:50,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:50,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:50,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 07:00:50,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:50,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35011,1696489207914': 2023-10-05 07:00:50,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-10-05 07:00:50,230 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-10-05 07:00:50,230 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 07:00:50,230 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 07:00:50,230 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-10-05 07:00:50,230 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 07:00:50,233 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,233 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,233 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,233 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:50,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,233 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:50,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,233 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:50,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,233 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:50,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:50,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:50,233 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:50,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:50,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:50,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:00:50,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:00:50,234 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:50,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:00:50,234 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 07:00:50,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:00:50,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 07:00:50,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:50,236 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,237 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:50,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:00:50,237 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-10-05 07:00:50,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:50,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,243 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,243 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:50,243 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,243 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:50,243 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:00:50,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:50,243 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:50,243 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:50,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:50,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:50,243 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:50,243 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:50,243 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-10-05 07:00:50,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:00:50,243 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:00:50,243 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:00:50,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:50,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:00:50,244 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-10-05 07:00:50,244 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:50,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-10-05 07:00:50,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:50,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 07:00:50,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:50,245 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:00:50,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:00:50,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:00:50,246 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,246 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:00:50,246 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:00:50,246 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,246 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202310053993ff71e7eb4541a403355fce629b59, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005a0f80c934f3c4721b571b029f8171606] mob files 2023-10-05 07:00:50,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202310053993ff71e7eb4541a403355fce629b59 2023-10-05 07:00:50,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005a0f80c934f3c4721b571b029f8171606 2023-10-05 07:00:50,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-10-05 07:00:50,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,276 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-10-05 07:00:50,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,276 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1696489250112Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1696489250256 (+144 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1696489250256Loading Region manifests for snaptb0-testConsecutiveExports at 1696489250256Writing data manifest for snaptb0-testConsecutiveExports at 1696489250260 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1696489250268 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1696489250276 (+8 ms) 2023-10-05 07:00:50,279 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-10-05 07:00:50,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 166 msec 2023-10-05 07:00:50,415 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:00:50,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-10-05 07:00:50,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 07:00:50,416 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416 2023-10-05 07:00:50,416 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416, srcFsUri=hdfs://localhost:41859, srcDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:00:50,438 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41859, inputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:00:50,438 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@56ec3d7, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,438 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41859, inputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0, snapshotDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-05 07:00:50,446 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 07:00:50,457 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:50,458 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:50,458 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:50,458 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:51,352 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop-1078350159154934375.jar 2023-10-05 07:00:51,353 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:51,353 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:51,420 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop-2126112561733342373.jar 2023-10-05 07:00:51,421 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:51,421 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:51,421 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:51,422 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:51,422 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:51,422 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 07:00:51,423 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 07:00:51,423 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 07:00:51,423 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 07:00:51,424 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 07:00:51,424 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 07:00:51,425 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 07:00:51,425 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 07:00:51,425 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 07:00:51,426 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 07:00:51,427 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 07:00:51,427 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:00:51,428 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:00:51,429 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:00:51,430 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:00:51,430 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:00:51,431 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:00:51,432 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:00:51,813 WARN [Listener at jenkins-hbase4.apache.org/36167] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 07:00:51,816 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-05 07:00:51,818 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-05 07:00:53,553 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 07:00:53,553 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 07:00:53,556 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0002_000001 (auth:SIMPLE) 2023-10-05 07:00:54,348 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 07:00:54,361 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0003_000001 (auth:SIMPLE) 2023-10-05 07:00:58,273 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0003_000001 (auth:SIMPLE) 2023-10-05 07:01:00,497 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0003_000001 (auth:SIMPLE) 2023-10-05 07:01:02,807 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0003_000001 (auth:SIMPLE) 2023-10-05 07:01:03,975 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 07:01:03,975 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 07:01:03,979 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-05 07:01:03,979 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 07:01:03,980 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 07:01:03,980 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740582836_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 07:01:03,983 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 07:01:03,983 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 07:01:03,983 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3ace7065 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 07:01:03,983 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 07:01:03,984 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 07:01:03,985 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416, srcFsUri=hdfs://localhost:41859, srcDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:01:04,006 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41859, inputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:01:04,006 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@387b3a74, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 07:01:04,006 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41859, inputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0, snapshotDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-10-05 07:01:04,018 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-10-05 07:01:04,029 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:04,030 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:04,030 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:04,031 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:04,908 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop-6752184152649989030.jar 2023-10-05 07:01:04,908 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:04,909 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:04,976 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop-4067869237413439968.jar 2023-10-05 07:01:04,976 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:04,976 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:04,977 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:04,977 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:04,978 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:04,978 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:04,978 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 07:01:04,979 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 07:01:04,979 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 07:01:04,979 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 07:01:04,980 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 07:01:04,980 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 07:01:04,981 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 07:01:04,981 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 07:01:04,981 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 07:01:04,982 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 07:01:04,982 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:01:04,983 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:01:04,983 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:01:04,984 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:01:04,984 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:01:04,984 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:01:04,985 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:01:05,374 WARN [Listener at jenkins-hbase4.apache.org/36167] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 07:01:05,377 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-10-05 07:01:05,379 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-10-05 07:01:08,980 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 07:01:08,980 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 07:01:08,983 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0003_000001 (auth:SIMPLE) 2023-10-05 07:01:09,569 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0004_000001 (auth:SIMPLE) 2023-10-05 07:01:13,220 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0004_000001 (auth:SIMPLE) 2023-10-05 07:01:15,430 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0004_000001 (auth:SIMPLE) 2023-10-05 07:01:17,725 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0004_000001 (auth:SIMPLE) 2023-10-05 07:01:19,541 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 07:01:19,541 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 07:01:19,544 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-10-05 07:01:19,544 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 07:01:19,544 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 07:01:19,544 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740582836_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 07:01:19,548 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 07:01:19,548 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 07:01:19,548 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3ace7065 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-10-05 07:01:19,549 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-10-05 07:01:19,549 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/local-export-1696489250416/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-10-05 07:01:19,563 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-10-05 07:01:19,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-10-05 07:01:19,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-10-05 07:01:19,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 07:01:19,567 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489279567"}]},"ts":"1696489279567"} 2023-10-05 07:01:19,569 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-10-05 07:01:19,572 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-10-05 07:01:19,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=77f8c2f6fd693262cb3fe32d879b329d, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f369dbebd76c07cbb3a5a10a77b20bfa, UNASSIGN}] 2023-10-05 07:01:19,575 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=77f8c2f6fd693262cb3fe32d879b329d, UNASSIGN 2023-10-05 07:01:19,575 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f369dbebd76c07cbb3a5a10a77b20bfa, UNASSIGN 2023-10-05 07:01:19,576 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=77f8c2f6fd693262cb3fe32d879b329d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:19,576 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=f369dbebd76c07cbb3a5a10a77b20bfa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:19,576 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696489279576"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489279576"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489279576"}]},"ts":"1696489279576"} 2023-10-05 07:01:19,576 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696489279576"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489279576"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489279576"}]},"ts":"1696489279576"} 2023-10-05 07:01:19,577 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 77f8c2f6fd693262cb3fe32d879b329d, server=jenkins-hbase4.apache.org,35011,1696489207914}] 2023-10-05 07:01:19,578 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure f369dbebd76c07cbb3a5a10a77b20bfa, server=jenkins-hbase4.apache.org,33577,1696489207986}] 2023-10-05 07:01:19,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 07:01:19,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 77f8c2f6fd693262cb3fe32d879b329d 2023-10-05 07:01:19,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 77f8c2f6fd693262cb3fe32d879b329d, disabling compactions & flushes 2023-10-05 07:01:19,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:01:19,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:01:19,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. after waiting 0 ms 2023-10-05 07:01:19,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:01:19,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f369dbebd76c07cbb3a5a10a77b20bfa 2023-10-05 07:01:19,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f369dbebd76c07cbb3a5a10a77b20bfa, disabling compactions & flushes 2023-10-05 07:01:19,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. 2023-10-05 07:01:19,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. 2023-10-05 07:01:19,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. after waiting 0 ms 2023-10-05 07:01:19,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. 2023-10-05 07:01:19,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 07:01:19,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 07:01:19,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:01:19,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d. 2023-10-05 07:01:19,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 77f8c2f6fd693262cb3fe32d879b329d: 2023-10-05 07:01:19,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:01:19,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa. 2023-10-05 07:01:19,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f369dbebd76c07cbb3a5a10a77b20bfa: 2023-10-05 07:01:19,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 77f8c2f6fd693262cb3fe32d879b329d 2023-10-05 07:01:19,748 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=77f8c2f6fd693262cb3fe32d879b329d, regionState=CLOSED 2023-10-05 07:01:19,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f369dbebd76c07cbb3a5a10a77b20bfa 2023-10-05 07:01:19,749 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696489279748"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489279748"}]},"ts":"1696489279748"} 2023-10-05 07:01:19,749 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=f369dbebd76c07cbb3a5a10a77b20bfa, regionState=CLOSED 2023-10-05 07:01:19,749 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1696489279749"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489279749"}]},"ts":"1696489279749"} 2023-10-05 07:01:19,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-10-05 07:01:19,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 77f8c2f6fd693262cb3fe32d879b329d, server=jenkins-hbase4.apache.org,35011,1696489207914 in 173 msec 2023-10-05 07:01:19,752 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-10-05 07:01:19,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure f369dbebd76c07cbb3a5a10a77b20bfa, server=jenkins-hbase4.apache.org,33577,1696489207986 in 173 msec 2023-10-05 07:01:19,753 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=77f8c2f6fd693262cb3fe32d879b329d, UNASSIGN in 180 msec 2023-10-05 07:01:19,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-05 07:01:19,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f369dbebd76c07cbb3a5a10a77b20bfa, UNASSIGN in 181 msec 2023-10-05 07:01:19,755 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489279755"}]},"ts":"1696489279755"} 2023-10-05 07:01:19,757 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-10-05 07:01:19,758 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-10-05 07:01:19,760 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 196 msec 2023-10-05 07:01:19,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-10-05 07:01:19,869 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-10-05 07:01:19,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-10-05 07:01:19,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 07:01:19,873 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 07:01:19,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-10-05 07:01:19,874 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 07:01:19,877 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39927] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-10-05 07:01:19,879 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d 2023-10-05 07:01:19,880 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa 2023-10-05 07:01:19,880 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 07:01:19,880 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 07:01:19,880 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 07:01:19,880 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 07:01:19,881 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 07:01:19,881 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 07:01:19,881 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 07:01:19,881 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-10-05 07:01:19,882 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d/cf, FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d/recovered.edits] 2023-10-05 07:01:19,882 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa/cf, FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa/recovered.edits] 2023-10-05 07:01:19,884 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 07:01:19,884 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 07:01:19,884 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:19,884 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 07:01:19,884 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-10-05 07:01:19,884 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:19,884 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:19,884 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:19,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-05 07:01:19,888 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d/cf/465edd09012f4eb98f6fdee949a5916a to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d/cf/465edd09012f4eb98f6fdee949a5916a 2023-10-05 07:01:19,888 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa/cf/9b7335197ff94efaa07dc5f532d075e4 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa/cf/9b7335197ff94efaa07dc5f532d075e4 2023-10-05 07:01:19,894 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d/recovered.edits/9.seqid to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d/recovered.edits/9.seqid 2023-10-05 07:01:19,894 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa/recovered.edits/9.seqid to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa/recovered.edits/9.seqid 2023-10-05 07:01:19,895 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/77f8c2f6fd693262cb3fe32d879b329d 2023-10-05 07:01:19,895 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testConsecutiveExports/f369dbebd76c07cbb3a5a10a77b20bfa 2023-10-05 07:01:19,895 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-10-05 07:01:19,896 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-05 07:01:19,896 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-10-05 07:01:19,900 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202310053993ff71e7eb4541a403355fce629b59 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202310053993ff71e7eb4541a403355fce629b59 2023-10-05 07:01:19,901 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005a0f80c934f3c4721b571b029f8171606 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20231005a0f80c934f3c4721b571b029f8171606 2023-10-05 07:01:19,902 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-10-05 07:01:19,904 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 07:01:19,907 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-10-05 07:01:19,909 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-10-05 07:01:19,910 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 07:01:19,910 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-10-05 07:01:19,910 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696489279910"}]},"ts":"9223372036854775807"} 2023-10-05 07:01:19,910 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696489279910"}]},"ts":"9223372036854775807"} 2023-10-05 07:01:19,912 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 07:01:19,912 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 77f8c2f6fd693262cb3fe32d879b329d, NAME => 'testtb-testConsecutiveExports,,1696489249079.77f8c2f6fd693262cb3fe32d879b329d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f369dbebd76c07cbb3a5a10a77b20bfa, NAME => 'testtb-testConsecutiveExports,1,1696489249079.f369dbebd76c07cbb3a5a10a77b20bfa.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 07:01:19,912 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-10-05 07:01:19,912 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696489279912"}]},"ts":"9223372036854775807"} 2023-10-05 07:01:19,914 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-10-05 07:01:19,915 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-10-05 07:01:19,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 45 msec 2023-10-05 07:01:19,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-10-05 07:01:19,986 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-10-05 07:01:19,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-10-05 07:01:19,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-10-05 07:01:19,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-10-05 07:01:20,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testConsecutiveExports 2023-10-05 07:01:20,024 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 766), OpenFileDescriptor=903 (was 941), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=221 (was 338), ProcessCount=168 (was 168), AvailableMemoryMB=5849 (was 5955) 2023-10-05 07:01:20,024 WARN [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-10-05 07:01:20,042 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=221, ProcessCount=168, AvailableMemoryMB=5848 2023-10-05 07:01:20,042 WARN [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-10-05 07:01:20,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 07:01:20,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,047 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 07:01:20,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-10-05 07:01:20,048 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 07:01:20,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 07:01:20,051 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3 2023-10-05 07:01:20,051 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f 2023-10-05 07:01:20,052 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3 empty. 2023-10-05 07:01:20,052 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f empty. 2023-10-05 07:01:20,052 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3 2023-10-05 07:01:20,052 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f 2023-10-05 07:01:20,052 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-05 07:01:20,062 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-10-05 07:01:20,063 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => b7df7d096f54accaf1115e76ba16572f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp 2023-10-05 07:01:20,063 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 02485a41c30f5b9d17ab2fa0704542a3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp 2023-10-05 07:01:20,071 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:20,071 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 02485a41c30f5b9d17ab2fa0704542a3, disabling compactions & flushes 2023-10-05 07:01:20,071 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. 2023-10-05 07:01:20,071 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. 2023-10-05 07:01:20,071 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. after waiting 0 ms 2023-10-05 07:01:20,071 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. 2023-10-05 07:01:20,071 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. 2023-10-05 07:01:20,071 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 02485a41c30f5b9d17ab2fa0704542a3: 2023-10-05 07:01:20,071 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:20,071 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing b7df7d096f54accaf1115e76ba16572f, disabling compactions & flushes 2023-10-05 07:01:20,071 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:20,071 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:20,071 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. after waiting 0 ms 2023-10-05 07:01:20,072 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:20,072 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:20,072 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for b7df7d096f54accaf1115e76ba16572f: 2023-10-05 07:01:20,074 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 07:01:20,075 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696489280075"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489280075"}]},"ts":"1696489280075"} 2023-10-05 07:01:20,075 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696489280075"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489280075"}]},"ts":"1696489280075"} 2023-10-05 07:01:20,081 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 07:01:20,081 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 07:01:20,082 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489280081"}]},"ts":"1696489280081"} 2023-10-05 07:01:20,083 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-10-05 07:01:20,094 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 07:01:20,095 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 07:01:20,096 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 07:01:20,096 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 07:01:20,096 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 07:01:20,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b7df7d096f54accaf1115e76ba16572f, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02485a41c30f5b9d17ab2fa0704542a3, ASSIGN}] 2023-10-05 07:01:20,098 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b7df7d096f54accaf1115e76ba16572f, ASSIGN 2023-10-05 07:01:20,098 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02485a41c30f5b9d17ab2fa0704542a3, ASSIGN 2023-10-05 07:01:20,099 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b7df7d096f54accaf1115e76ba16572f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33577,1696489207986; forceNewPlan=false, retain=false 2023-10-05 07:01:20,099 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02485a41c30f5b9d17ab2fa0704542a3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39927,1696489208029; forceNewPlan=false, retain=false 2023-10-05 07:01:20,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 07:01:20,249 INFO [jenkins-hbase4:33507] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 07:01:20,252 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=b7df7d096f54accaf1115e76ba16572f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,252 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=02485a41c30f5b9d17ab2fa0704542a3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,252 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696489280252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489280252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489280252"}]},"ts":"1696489280252"} 2023-10-05 07:01:20,252 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696489280252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489280252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489280252"}]},"ts":"1696489280252"} 2023-10-05 07:01:20,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure b7df7d096f54accaf1115e76ba16572f, server=jenkins-hbase4.apache.org,33577,1696489207986}] 2023-10-05 07:01:20,255 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 02485a41c30f5b9d17ab2fa0704542a3, server=jenkins-hbase4.apache.org,39927,1696489208029}] 2023-10-05 07:01:20,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 07:01:20,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:20,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b7df7d096f54accaf1115e76ba16572f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 07:01:20,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. service=AccessControlService 2023-10-05 07:01:20,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. 2023-10-05 07:01:20,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 02485a41c30f5b9d17ab2fa0704542a3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 07:01:20,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:01:20,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion b7df7d096f54accaf1115e76ba16572f 2023-10-05 07:01:20,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. service=AccessControlService 2023-10-05 07:01:20,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:20,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b7df7d096f54accaf1115e76ba16572f 2023-10-05 07:01:20,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:01:20,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b7df7d096f54accaf1115e76ba16572f 2023-10-05 07:01:20,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 02485a41c30f5b9d17ab2fa0704542a3 2023-10-05 07:01:20,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:20,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 02485a41c30f5b9d17ab2fa0704542a3 2023-10-05 07:01:20,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 02485a41c30f5b9d17ab2fa0704542a3 2023-10-05 07:01:20,424 INFO [StoreOpener-b7df7d096f54accaf1115e76ba16572f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b7df7d096f54accaf1115e76ba16572f 2023-10-05 07:01:20,424 INFO [StoreOpener-02485a41c30f5b9d17ab2fa0704542a3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 02485a41c30f5b9d17ab2fa0704542a3 2023-10-05 07:01:20,425 DEBUG [StoreOpener-b7df7d096f54accaf1115e76ba16572f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f/cf 2023-10-05 07:01:20,425 DEBUG [StoreOpener-02485a41c30f5b9d17ab2fa0704542a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3/cf 2023-10-05 07:01:20,425 DEBUG [StoreOpener-b7df7d096f54accaf1115e76ba16572f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f/cf 2023-10-05 07:01:20,425 DEBUG [StoreOpener-02485a41c30f5b9d17ab2fa0704542a3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3/cf 2023-10-05 07:01:20,426 INFO [StoreOpener-b7df7d096f54accaf1115e76ba16572f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7df7d096f54accaf1115e76ba16572f columnFamilyName cf 2023-10-05 07:01:20,426 INFO [StoreOpener-02485a41c30f5b9d17ab2fa0704542a3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02485a41c30f5b9d17ab2fa0704542a3 columnFamilyName cf 2023-10-05 07:01:20,428 INFO [StoreOpener-b7df7d096f54accaf1115e76ba16572f-1] regionserver.HStore(310): Store=b7df7d096f54accaf1115e76ba16572f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:01:20,428 INFO [StoreOpener-02485a41c30f5b9d17ab2fa0704542a3-1] regionserver.HStore(310): Store=02485a41c30f5b9d17ab2fa0704542a3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:01:20,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f 2023-10-05 07:01:20,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3 2023-10-05 07:01:20,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f 2023-10-05 07:01:20,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3 2023-10-05 07:01:20,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b7df7d096f54accaf1115e76ba16572f 2023-10-05 07:01:20,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 02485a41c30f5b9d17ab2fa0704542a3 2023-10-05 07:01:20,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:01:20,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b7df7d096f54accaf1115e76ba16572f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60018270, jitterRate=-0.10565808415412903}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:01:20,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b7df7d096f54accaf1115e76ba16572f: 2023-10-05 07:01:20,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:01:20,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f., pid=60, masterSystemTime=1696489280412 2023-10-05 07:01:20,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 02485a41c30f5b9d17ab2fa0704542a3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62167849, jitterRate=-0.07362686097621918}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:01:20,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 02485a41c30f5b9d17ab2fa0704542a3: 2023-10-05 07:01:20,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3., pid=61, masterSystemTime=1696489280412 2023-10-05 07:01:20,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:20,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:20,437 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=b7df7d096f54accaf1115e76ba16572f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,437 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696489280437"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489280437"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489280437"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489280437"}]},"ts":"1696489280437"} 2023-10-05 07:01:20,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. 2023-10-05 07:01:20,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. 2023-10-05 07:01:20,438 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=02485a41c30f5b9d17ab2fa0704542a3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,438 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696489280438"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489280438"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489280438"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489280438"}]},"ts":"1696489280438"} 2023-10-05 07:01:20,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-10-05 07:01:20,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure b7df7d096f54accaf1115e76ba16572f, server=jenkins-hbase4.apache.org,33577,1696489207986 in 185 msec 2023-10-05 07:01:20,442 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-10-05 07:01:20,442 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 02485a41c30f5b9d17ab2fa0704542a3, server=jenkins-hbase4.apache.org,39927,1696489208029 in 185 msec 2023-10-05 07:01:20,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b7df7d096f54accaf1115e76ba16572f, ASSIGN in 345 msec 2023-10-05 07:01:20,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-10-05 07:01:20,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02485a41c30f5b9d17ab2fa0704542a3, ASSIGN in 346 msec 2023-10-05 07:01:20,445 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 07:01:20,445 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489280445"}]},"ts":"1696489280445"} 2023-10-05 07:01:20,446 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-10-05 07:01:20,448 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 07:01:20,448 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-10-05 07:01:20,450 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39927] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 07:01:20,452 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:20,452 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:20,452 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:20,452 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:20,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:20,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:20,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:20,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:20,456 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 411 msec 2023-10-05 07:01:20,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-10-05 07:01:20,652 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-10-05 07:01:20,654 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,655 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:20,656 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 07:01:20,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 07:01:20,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696489280671 (current time:1696489280671). 2023-10-05 07:01:20,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 07:01:20,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x4276e642 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:01:20,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b568e5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:01:20,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:20,683 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:20,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4276e642 to 127.0.0.1:58805 2023-10-05 07:01:20,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:01:20,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x1050ef9c to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:01:20,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65615f22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:01:20,693 DEBUG [hconnection-0x5afa19bc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:20,694 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:20,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:20,701 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:20,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1050ef9c to 127.0.0.1:58805 2023-10-05 07:01:20,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:01:20,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 07:01:20,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 07:01:20,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 07:01:20,705 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot, current working dir path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 07:01:20,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 07:01:20,707 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 07:01:20,708 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696489880708 2023-10-05 07:01:20,708 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 07:01:20,709 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 07:01:20,710 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 07:01:20,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 07:01:20,710 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 07:01:20,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-05 07:01:20,712 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 07:01:20,713 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696489880713 2023-10-05 07:01:20,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,723 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-05 07:01:20,723 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:20,724 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-05 07:01:20,724 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-05 07:01:20,725 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,725 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,726 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:20,726 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:20,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:20,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:20,726 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:20,726 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:20,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:20,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,727 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,727 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,727 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,727 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 07:01:20,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 07:01:20,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 07:01:20,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-10-05 07:01:20,728 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 07:01:20,728 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 07:01:20,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,728 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,728 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,728 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 07:01:20,728 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 07:01:20,728 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:20,728 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:20,729 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 07:01:20,730 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 07:01:20,730 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 07:01:20,728 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 07:01:20,730 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 07:01:20,730 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 07:01:20,731 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 07:01:20,731 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,731 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 07:01:20,731 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:20,732 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 07:01:20,732 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 07:01:20,732 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 07:01:20,733 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,733 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,733 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:20,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:20,733 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,733 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,734 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:20,734 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,734 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,734 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:20,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:20,735 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,735 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:20,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:20,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:20,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:20,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 07:01:20,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@473fa00[Count = 1] remaining members to acquire global barrier 2023-10-05 07:01:20,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:20,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:20,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:20,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:20,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:20,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:20,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 07:01:20,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@473fa00[Count = 0] remaining members to acquire global barrier 2023-10-05 07:01:20,738 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-05 07:01:20,738 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,741 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,741 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,741 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 07:01:20,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,741 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 07:01:20,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,741 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 07:01:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:01:20,742 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:01:20,742 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. 2023-10-05 07:01:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 07:01:20,742 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. started... 2023-10-05 07:01:20,742 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,742 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 07:01:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:01:20,742 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. started... 2023-10-05 07:01:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:01:20,743 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02485a41c30f5b9d17ab2fa0704542a3: 2023-10-05 07:01:20,742 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35011,1696489207914' in zk 2023-10-05 07:01:20,744 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b7df7d096f54accaf1115e76ba16572f: 2023-10-05 07:01:20,744 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,744 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,744 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:01:20,744 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:01:20,744 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 07:01:20,744 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 07:01:20,753 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 07:01:20,753 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:20,753 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 07:01:20,761 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. completed. 2023-10-05 07:01:20,761 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:20,761 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:01:20,761 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:01:20,761 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,761 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 07:01:20,761 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33577,1696489207986' in zk 2023-10-05 07:01:20,761 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. completed. 2023-10-05 07:01:20,762 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. 2023-10-05 07:01:20,762 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:01:20,762 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:01:20,762 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,762 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 07:01:20,762 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39927,1696489208029' in zk 2023-10-05 07:01:20,763 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,763 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 07:01:20,763 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:20,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:20,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:20,763 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 07:01:20,766 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,766 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 07:01:20,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:20,766 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:20,766 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 07:01:20,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:20,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:20,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:20,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:20,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33577,1696489207986': 2023-10-05 07:01:20,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-05 07:01:20,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:20,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:20,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:20,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:20,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:20,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:20,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:20,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39927,1696489208029': 2023-10-05 07:01:20,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-05 07:01:20,774 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-05 07:01:20,774 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 07:01:20,774 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 07:01:20,774 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,774 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 07:01:20,776 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,776 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,777 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:20,777 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,777 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:20,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:20,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:20,777 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,777 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:20,777 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:20,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:20,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:20,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:20,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:20,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:20,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:20,778 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:20,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,778 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:20,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:20,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,780 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:20,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:20,780 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,781 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:20,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,784 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,784 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,784 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:20,784 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:20,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:20,784 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:20,785 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:20,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:20,785 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:20,785 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:20,785 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:20,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:20,785 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:20,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:20,785 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:20,788 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:20,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:20,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 07:01:20,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:20,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:20,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:20,788 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,788 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:20,788 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,788 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:20,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:20,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:20,788 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:20,789 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 07:01:20,789 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,810 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:01:20,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 07:01:20,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-05 07:01:20,811 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 07:01:20,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,819 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-05 07:01:20,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,820 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:20,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696489280708Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696489280798 (+90 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696489280798Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696489280798Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696489280803 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1696489280813 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696489280819 (+6 ms) 2023-10-05 07:01:20,822 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 07:01:20,824 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 113 msec 2023-10-05 07:01:21,012 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:01:21,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 07:01:21,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 07:01:21,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33577] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 07:01:21,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39927] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 07:01:21,020 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,020 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:21,020 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 07:01:21,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 07:01:21,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696489281031 (current time:1696489281031). 2023-10-05 07:01:21,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 07:01:21,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x6935aef3 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:01:21,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@626dac6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:01:21,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:21,042 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:21,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6935aef3 to 127.0.0.1:58805 2023-10-05 07:01:21,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:01:21,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x28535cf1 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:01:21,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c553d3e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:01:21,050 DEBUG [hconnection-0x63d4da2b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:21,052 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:21,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:21,056 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:21,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28535cf1 to 127.0.0.1:58805 2023-10-05 07:01:21,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:01:21,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-10-05 07:01:21,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 07:01:21,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 07:01:21,061 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot, current working dir path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 07:01:21,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 07:01:21,063 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 07:01:21,063 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1696489881063 2023-10-05 07:01:21,063 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-10-05 07:01:21,065 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 07:01:21,065 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 07:01:21,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 07:01:21,066 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-10-05 07:01:21,067 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-10-05 07:01:21,067 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 07:01:21,068 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1696489881068 2023-10-05 07:01:21,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,077 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-10-05 07:01:21,077 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:21,078 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-10-05 07:01:21,078 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-10-05 07:01:21,078 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,078 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,079 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:21,079 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:21,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:21,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:21,079 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,079 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:21,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:21,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:21,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:21,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:21,080 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,080 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,080 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,080 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 07:01:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 07:01:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 07:01:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-10-05 07:01:21,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,081 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 07:01:21,081 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 07:01:21,081 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-10-05 07:01:21,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,081 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 07:01:21,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,081 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 07:01:21,081 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-10-05 07:01:21,081 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:21,081 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:21,082 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 07:01:21,083 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 07:01:21,083 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 07:01:21,081 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:21,083 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 07:01:21,084 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-10-05 07:01:21,084 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 07:01:21,084 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 07:01:21,083 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-10-05 07:01:21,084 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-10-05 07:01:21,085 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,086 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,086 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,086 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:21,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:21,086 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,086 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:21,086 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,086 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,087 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:21,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:21,087 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,087 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:21,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:21,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:21,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:21,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 07:01:21,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@376b61ee[Count = 1] remaining members to acquire global barrier 2023-10-05 07:01:21,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:21,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:21,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:21,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:21,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:21,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:21,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-10-05 07:01:21,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@376b61ee[Count = 0] remaining members to acquire global barrier 2023-10-05 07:01:21,091 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-10-05 07:01:21,091 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,093 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,093 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,093 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,093 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 07:01:21,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,093 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,093 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 07:01:21,093 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 07:01:21,093 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-10-05 07:01:21,093 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35011,1696489207914' in zk 2023-10-05 07:01:21,094 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:01:21,094 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:01:21,094 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:01:21,094 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. 2023-10-05 07:01:21,094 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:01:21,094 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,094 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 07:01:21,094 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:21,094 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. started... 2023-10-05 07:01:21,094 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. started... 2023-10-05 07:01:21,094 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b7df7d096f54accaf1115e76ba16572f 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-05 07:01:21,094 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 02485a41c30f5b9d17ab2fa0704542a3 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-05 07:01:21,095 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 07:01:21,095 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:21,095 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 07:01:21,112 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310058ab173b5f4a04b5695c8c2abda6702e5 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310058ab173b5f4a04b5695c8c2abda6702e5 2023-10-05 07:01:21,113 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231005b8cf85977bfb45a48048979669ace7c8 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231005b8cf85977bfb45a48048979669ace7c8 2023-10-05 07:01:21,119 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f/.tmp/cf/763a0d53dc834cb39d3739f078fbce81 2023-10-05 07:01:21,121 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3/.tmp/cf/dedd1d41b98e46b3ab6a5fc6c3b75e45 2023-10-05 07:01:21,124 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f/.tmp/cf/763a0d53dc834cb39d3739f078fbce81 as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f/cf/763a0d53dc834cb39d3739f078fbce81 2023-10-05 07:01:21,126 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3/.tmp/cf/dedd1d41b98e46b3ab6a5fc6c3b75e45 as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3/cf/dedd1d41b98e46b3ab6a5fc6c3b75e45 2023-10-05 07:01:21,129 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f/cf/763a0d53dc834cb39d3739f078fbce81, entries=3, sequenceid=6, filesize=5.4 K 2023-10-05 07:01:21,130 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for b7df7d096f54accaf1115e76ba16572f in 36ms, sequenceid=6, compaction requested=false 2023-10-05 07:01:21,130 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-10-05 07:01:21,130 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b7df7d096f54accaf1115e76ba16572f: 2023-10-05 07:01:21,130 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3/cf/dedd1d41b98e46b3ab6a5fc6c3b75e45, entries=47, sequenceid=6, filesize=13.5 K 2023-10-05 07:01:21,130 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,130 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:01:21,131 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f/cf/763a0d53dc834cb39d3739f078fbce81] hfiles 2023-10-05 07:01:21,131 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f/cf/763a0d53dc834cb39d3739f078fbce81 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,131 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 02485a41c30f5b9d17ab2fa0704542a3 in 37ms, sequenceid=6, compaction requested=false 2023-10-05 07:01:21,133 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 02485a41c30f5b9d17ab2fa0704542a3: 2023-10-05 07:01:21,133 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,133 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:01:21,133 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3/cf/dedd1d41b98e46b3ab6a5fc6c3b75e45] hfiles 2023-10-05 07:01:21,133 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3/cf/dedd1d41b98e46b3ab6a5fc6c3b75e45 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,141 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. completed. 2023-10-05 07:01:21,141 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:21,141 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:01:21,141 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:01:21,141 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,142 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 07:01:21,142 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. completed. 2023-10-05 07:01:21,142 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. 2023-10-05 07:01:21,142 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33577,1696489207986' in zk 2023-10-05 07:01:21,142 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:01:21,142 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:01:21,142 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,142 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-10-05 07:01:21,142 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39927,1696489208029' in zk 2023-10-05 07:01:21,144 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,144 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 07:01:21,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:21,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:21,144 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:21,144 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 07:01:21,146 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,146 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-10-05 07:01:21,146 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:21,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:21,146 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-10-05 07:01:21,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:21,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:21,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:21,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:21,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33577,1696489207986': 2023-10-05 07:01:21,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-10-05 07:01:21,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:21,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:21,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:21,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:21,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:21,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:21,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:21,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39927,1696489208029': 2023-10-05 07:01:21,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-10-05 07:01:21,154 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-10-05 07:01:21,154 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 07:01:21,154 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 07:01:21,154 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,154 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 07:01:21,163 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,163 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,163 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,163 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:21,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:21,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:21,163 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,163 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:21,163 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:21,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:21,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,163 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:21,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:21,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:21,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:21,164 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:21,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:21,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:21,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,164 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:21,165 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:01:21,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:21,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 07:01:21,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-10-05 07:01:21,167 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 07:01:21,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,167 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:21,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:21,167 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,168 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,170 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,170 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:21,171 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:21,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:21,171 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:21,170 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:21,171 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:21,171 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:21,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:21,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:21,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:21,171 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,171 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:21,171 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,171 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:21,173 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:21,171 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:21,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,173 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:21,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:21,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:21,173 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 07:01:21,173 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:21,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:21,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:21,173 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,174 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:21,174 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,174 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231005b8cf85977bfb45a48048979669ace7c8, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310058ab173b5f4a04b5695c8c2abda6702e5] mob files 2023-10-05 07:01:21,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231005b8cf85977bfb45a48048979669ace7c8 2023-10-05 07:01:21,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310058ab173b5f4a04b5695c8c2abda6702e5 2023-10-05 07:01:21,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,203 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-10-05 07:01:21,203 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,204 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:21,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1696489281063Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1696489281181 (+118 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696489281181Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1696489281181Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1696489281185 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1696489281195 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1696489281203 (+8 ms) 2023-10-05 07:01:21,206 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-10-05 07:01:21,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 143 msec 2023-10-05 07:01:21,367 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:01:21,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-10-05 07:01:21,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 07:01:21,396 DEBUG [Listener at jenkins-hbase4.apache.org/36167] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 07:01:21,401 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 07:01:21,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33577] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 07:01:21,404 DEBUG [Listener at jenkins-hbase4.apache.org/36167] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 07:01:21,406 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52258, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 07:01:21,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35011] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 07:01:21,407 DEBUG [Listener at jenkins-hbase4.apache.org/36167] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-05 07:01:21,410 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-05 07:01:21,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39927] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-10-05 07:01:21,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-05 07:01:21,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:21,415 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 07:01:21,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-10-05 07:01:21,416 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 07:01:21,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 07:01:21,418 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34 2023-10-05 07:01:21,418 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f 2023-10-05 07:01:21,419 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f empty. 2023-10-05 07:01:21,419 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34 empty. 2023-10-05 07:01:21,419 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f 2023-10-05 07:01:21,420 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34 2023-10-05 07:01:21,420 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-05 07:01:21,430 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-10-05 07:01:21,432 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3efaa093538a017206223305dcfbbe34, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp 2023-10-05 07:01:21,432 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 045d08be0eb68081752fb318890e7c9f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp 2023-10-05 07:01:21,441 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:21,441 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 3efaa093538a017206223305dcfbbe34, disabling compactions & flushes 2023-10-05 07:01:21,441 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34. 2023-10-05 07:01:21,441 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34. 2023-10-05 07:01:21,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34. after waiting 0 ms 2023-10-05 07:01:21,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34. 2023-10-05 07:01:21,442 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34. 2023-10-05 07:01:21,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:21,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 3efaa093538a017206223305dcfbbe34: 2023-10-05 07:01:21,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 045d08be0eb68081752fb318890e7c9f, disabling compactions & flushes 2023-10-05 07:01:21,442 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f. 2023-10-05 07:01:21,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f. 2023-10-05 07:01:21,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f. after waiting 0 ms 2023-10-05 07:01:21,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f. 2023-10-05 07:01:21,442 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f. 2023-10-05 07:01:21,442 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 045d08be0eb68081752fb318890e7c9f: 2023-10-05 07:01:21,444 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 07:01:21,445 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696489281445"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489281445"}]},"ts":"1696489281445"} 2023-10-05 07:01:21,445 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696489281445"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489281445"}]},"ts":"1696489281445"} 2023-10-05 07:01:21,447 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 07:01:21,448 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 07:01:21,448 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489281448"}]},"ts":"1696489281448"} 2023-10-05 07:01:21,449 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-10-05 07:01:21,453 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 07:01:21,454 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 07:01:21,454 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 07:01:21,454 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 07:01:21,454 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 07:01:21,454 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3efaa093538a017206223305dcfbbe34, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=045d08be0eb68081752fb318890e7c9f, ASSIGN}] 2023-10-05 07:01:21,457 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=045d08be0eb68081752fb318890e7c9f, ASSIGN 2023-10-05 07:01:21,457 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3efaa093538a017206223305dcfbbe34, ASSIGN 2023-10-05 07:01:21,458 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=045d08be0eb68081752fb318890e7c9f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33577,1696489207986; forceNewPlan=false, retain=false 2023-10-05 07:01:21,458 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3efaa093538a017206223305dcfbbe34, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39927,1696489208029; forceNewPlan=false, retain=false 2023-10-05 07:01:21,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 07:01:21,608 INFO [jenkins-hbase4:33507] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 07:01:21,611 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=045d08be0eb68081752fb318890e7c9f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,611 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=3efaa093538a017206223305dcfbbe34, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,611 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696489281611"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489281611"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489281611"}]},"ts":"1696489281611"} 2023-10-05 07:01:21,611 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696489281611"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489281611"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489281611"}]},"ts":"1696489281611"} 2023-10-05 07:01:21,613 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 3efaa093538a017206223305dcfbbe34, server=jenkins-hbase4.apache.org,39927,1696489208029}] 2023-10-05 07:01:21,614 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 045d08be0eb68081752fb318890e7c9f, server=jenkins-hbase4.apache.org,33577,1696489207986}] 2023-10-05 07:01:21,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 07:01:21,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f. 2023-10-05 07:01:21,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34. 2023-10-05 07:01:21,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3efaa093538a017206223305dcfbbe34, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34.', STARTKEY => '', ENDKEY => '2'} 2023-10-05 07:01:21,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 045d08be0eb68081752fb318890e7c9f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f.', STARTKEY => '2', ENDKEY => ''} 2023-10-05 07:01:21,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f. service=AccessControlService 2023-10-05 07:01:21,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34. service=AccessControlService 2023-10-05 07:01:21,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:01:21,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:01:21,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 3efaa093538a017206223305dcfbbe34 2023-10-05 07:01:21,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 045d08be0eb68081752fb318890e7c9f 2023-10-05 07:01:21,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:21,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:21,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3efaa093538a017206223305dcfbbe34 2023-10-05 07:01:21,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 045d08be0eb68081752fb318890e7c9f 2023-10-05 07:01:21,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3efaa093538a017206223305dcfbbe34 2023-10-05 07:01:21,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 045d08be0eb68081752fb318890e7c9f 2023-10-05 07:01:21,771 INFO [StoreOpener-3efaa093538a017206223305dcfbbe34-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3efaa093538a017206223305dcfbbe34 2023-10-05 07:01:21,771 INFO [StoreOpener-045d08be0eb68081752fb318890e7c9f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 045d08be0eb68081752fb318890e7c9f 2023-10-05 07:01:21,773 DEBUG [StoreOpener-3efaa093538a017206223305dcfbbe34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34/cf 2023-10-05 07:01:21,773 DEBUG [StoreOpener-045d08be0eb68081752fb318890e7c9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f/cf 2023-10-05 07:01:21,773 DEBUG [StoreOpener-045d08be0eb68081752fb318890e7c9f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f/cf 2023-10-05 07:01:21,773 DEBUG [StoreOpener-3efaa093538a017206223305dcfbbe34-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34/cf 2023-10-05 07:01:21,773 INFO [StoreOpener-045d08be0eb68081752fb318890e7c9f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 045d08be0eb68081752fb318890e7c9f columnFamilyName cf 2023-10-05 07:01:21,773 INFO [StoreOpener-3efaa093538a017206223305dcfbbe34-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3efaa093538a017206223305dcfbbe34 columnFamilyName cf 2023-10-05 07:01:21,774 INFO [StoreOpener-045d08be0eb68081752fb318890e7c9f-1] regionserver.HStore(310): Store=045d08be0eb68081752fb318890e7c9f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:01:21,774 INFO [StoreOpener-3efaa093538a017206223305dcfbbe34-1] regionserver.HStore(310): Store=3efaa093538a017206223305dcfbbe34/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:01:21,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34 2023-10-05 07:01:21,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f 2023-10-05 07:01:21,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34 2023-10-05 07:01:21,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f 2023-10-05 07:01:21,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 045d08be0eb68081752fb318890e7c9f 2023-10-05 07:01:21,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3efaa093538a017206223305dcfbbe34 2023-10-05 07:01:21,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:01:21,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:01:21,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 045d08be0eb68081752fb318890e7c9f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74615696, jitterRate=0.11186051368713379}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:01:21,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 045d08be0eb68081752fb318890e7c9f: 2023-10-05 07:01:21,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3efaa093538a017206223305dcfbbe34; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72138934, jitterRate=0.07495388388633728}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:01:21,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3efaa093538a017206223305dcfbbe34: 2023-10-05 07:01:21,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f., pid=70, masterSystemTime=1696489281765 2023-10-05 07:01:21,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34., pid=69, masterSystemTime=1696489281765 2023-10-05 07:01:21,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f. 2023-10-05 07:01:21,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f. 2023-10-05 07:01:21,783 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=045d08be0eb68081752fb318890e7c9f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:21,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34. 2023-10-05 07:01:21,784 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696489281783"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489281783"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489281783"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489281783"}]},"ts":"1696489281783"} 2023-10-05 07:01:21,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34. 2023-10-05 07:01:21,784 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=3efaa093538a017206223305dcfbbe34, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:21,784 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696489281784"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489281784"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489281784"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489281784"}]},"ts":"1696489281784"} 2023-10-05 07:01:21,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-10-05 07:01:21,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 045d08be0eb68081752fb318890e7c9f, server=jenkins-hbase4.apache.org,33577,1696489207986 in 171 msec 2023-10-05 07:01:21,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-05 07:01:21,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 3efaa093538a017206223305dcfbbe34, server=jenkins-hbase4.apache.org,39927,1696489208029 in 173 msec 2023-10-05 07:01:21,788 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=045d08be0eb68081752fb318890e7c9f, ASSIGN in 333 msec 2023-10-05 07:01:21,789 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-05 07:01:21,789 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3efaa093538a017206223305dcfbbe34, ASSIGN in 333 msec 2023-10-05 07:01:21,790 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 07:01:21,790 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489281790"}]},"ts":"1696489281790"} 2023-10-05 07:01:21,791 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-10-05 07:01:21,794 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 07:01:21,795 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-10-05 07:01:21,796 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39927] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-05 07:01:21,798 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:21,798 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:21,798 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:21,798 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:21,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:21,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:21,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:21,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:21,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:21,800 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:21,800 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:21,800 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:21,800 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 386 msec 2023-10-05 07:01:21,980 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-10-05 07:01:22,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-10-05 07:01:22,020 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-10-05 07:01:22,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 3efaa093538a017206223305dcfbbe34, 045d08be0eb68081752fb318890e7c9f 2023-10-05 07:01:22,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[3efaa093538a017206223305dcfbbe34, 045d08be0eb68081752fb318890e7c9f], force=true 2023-10-05 07:01:22,055 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[3efaa093538a017206223305dcfbbe34, 045d08be0eb68081752fb318890e7c9f], force=true 2023-10-05 07:01:22,055 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[3efaa093538a017206223305dcfbbe34, 045d08be0eb68081752fb318890e7c9f], force=true 2023-10-05 07:01:22,055 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[3efaa093538a017206223305dcfbbe34, 045d08be0eb68081752fb318890e7c9f], force=true 2023-10-05 07:01:22,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 07:01:22,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3efaa093538a017206223305dcfbbe34, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=045d08be0eb68081752fb318890e7c9f, UNASSIGN}] 2023-10-05 07:01:22,079 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3efaa093538a017206223305dcfbbe34, UNASSIGN 2023-10-05 07:01:22,079 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=045d08be0eb68081752fb318890e7c9f, UNASSIGN 2023-10-05 07:01:22,080 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=3efaa093538a017206223305dcfbbe34, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:22,080 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=045d08be0eb68081752fb318890e7c9f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:22,080 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696489282080"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489282080"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489282080"}]},"ts":"1696489282080"} 2023-10-05 07:01:22,080 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696489282080"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489282080"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489282080"}]},"ts":"1696489282080"} 2023-10-05 07:01:22,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 3efaa093538a017206223305dcfbbe34, server=jenkins-hbase4.apache.org,39927,1696489208029}] 2023-10-05 07:01:22,082 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 045d08be0eb68081752fb318890e7c9f, server=jenkins-hbase4.apache.org,33577,1696489207986}] 2023-10-05 07:01:22,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 07:01:22,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3efaa093538a017206223305dcfbbe34 2023-10-05 07:01:22,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 045d08be0eb68081752fb318890e7c9f 2023-10-05 07:01:22,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 045d08be0eb68081752fb318890e7c9f, disabling compactions & flushes 2023-10-05 07:01:22,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3efaa093538a017206223305dcfbbe34, disabling compactions & flushes 2023-10-05 07:01:22,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f. 2023-10-05 07:01:22,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34. 2023-10-05 07:01:22,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f. 2023-10-05 07:01:22,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34. 2023-10-05 07:01:22,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f. after waiting 0 ms 2023-10-05 07:01:22,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f. 2023-10-05 07:01:22,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34. after waiting 0 ms 2023-10-05 07:01:22,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34. 2023-10-05 07:01:22,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 045d08be0eb68081752fb318890e7c9f 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-05 07:01:22,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 3efaa093538a017206223305dcfbbe34 1/1 column families, dataSize=24 B heapSize=352 B 2023-10-05 07:01:22,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f/.tmp/cf/0367b5af4cb84f4490bb6b69af7d3855 2023-10-05 07:01:22,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34/.tmp/cf/1e6de3fdda1845739076eddca7486fcf 2023-10-05 07:01:22,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34/.tmp/cf/1e6de3fdda1845739076eddca7486fcf as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34/cf/1e6de3fdda1845739076eddca7486fcf 2023-10-05 07:01:22,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f/.tmp/cf/0367b5af4cb84f4490bb6b69af7d3855 as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f/cf/0367b5af4cb84f4490bb6b69af7d3855 2023-10-05 07:01:22,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34/cf/1e6de3fdda1845739076eddca7486fcf, entries=1, sequenceid=5, filesize=4.7 K 2023-10-05 07:01:22,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f/cf/0367b5af4cb84f4490bb6b69af7d3855, entries=1, sequenceid=5, filesize=4.7 K 2023-10-05 07:01:22,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 3efaa093538a017206223305dcfbbe34 in 23ms, sequenceid=5, compaction requested=false 2023-10-05 07:01:22,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 045d08be0eb68081752fb318890e7c9f in 23ms, sequenceid=5, compaction requested=false 2023-10-05 07:01:22,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-05 07:01:22,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-10-05 07:01:22,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:01:22,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:01:22,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f. 2023-10-05 07:01:22,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34. 2023-10-05 07:01:22,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 045d08be0eb68081752fb318890e7c9f: 2023-10-05 07:01:22,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3efaa093538a017206223305dcfbbe34: 2023-10-05 07:01:22,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3efaa093538a017206223305dcfbbe34 2023-10-05 07:01:22,279 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=3efaa093538a017206223305dcfbbe34, regionState=CLOSED 2023-10-05 07:01:22,279 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696489282278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489282278"}]},"ts":"1696489282278"} 2023-10-05 07:01:22,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 045d08be0eb68081752fb318890e7c9f 2023-10-05 07:01:22,280 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=045d08be0eb68081752fb318890e7c9f, regionState=CLOSED 2023-10-05 07:01:22,280 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1696489282280"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489282280"}]},"ts":"1696489282280"} 2023-10-05 07:01:22,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-10-05 07:01:22,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 3efaa093538a017206223305dcfbbe34, server=jenkins-hbase4.apache.org,39927,1696489208029 in 200 msec 2023-10-05 07:01:22,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-10-05 07:01:22,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 045d08be0eb68081752fb318890e7c9f, server=jenkins-hbase4.apache.org,33577,1696489207986 in 200 msec 2023-10-05 07:01:22,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=3efaa093538a017206223305dcfbbe34, UNASSIGN in 208 msec 2023-10-05 07:01:22,286 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-10-05 07:01:22,286 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=045d08be0eb68081752fb318890e7c9f, UNASSIGN in 208 msec 2023-10-05 07:01:22,332 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-10-05 07:01:22,334 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281412.3efaa093538a017206223305dcfbbe34.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 07:01:22,334 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1696489281412.045d08be0eb68081752fb318890e7c9f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 07:01:22,335 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-10-05 07:01:22,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 07:01:22,384 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bf55f37d7bd4df8267920a1602f34583, ASSIGN}] 2023-10-05 07:01:22,385 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bf55f37d7bd4df8267920a1602f34583, ASSIGN 2023-10-05 07:01:22,386 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bf55f37d7bd4df8267920a1602f34583, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,39927,1696489208029; forceNewPlan=false, retain=false 2023-10-05 07:01:22,536 INFO [jenkins-hbase4:33507] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-10-05 07:01:22,538 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=bf55f37d7bd4df8267920a1602f34583, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:22,538 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696489282538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489282538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489282538"}]},"ts":"1696489282538"} 2023-10-05 07:01:22,540 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure bf55f37d7bd4df8267920a1602f34583, server=jenkins-hbase4.apache.org,39927,1696489208029}] 2023-10-05 07:01:22,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 07:01:22,695 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583. 2023-10-05 07:01:22,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bf55f37d7bd4df8267920a1602f34583, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583.', STARTKEY => '', ENDKEY => ''} 2023-10-05 07:01:22,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583. service=AccessControlService 2023-10-05 07:01:22,695 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:01:22,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 bf55f37d7bd4df8267920a1602f34583 2023-10-05 07:01:22,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:22,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bf55f37d7bd4df8267920a1602f34583 2023-10-05 07:01:22,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bf55f37d7bd4df8267920a1602f34583 2023-10-05 07:01:22,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/.regioninfo 2023-10-05 07:01:22,705 INFO [StoreOpener-bf55f37d7bd4df8267920a1602f34583-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bf55f37d7bd4df8267920a1602f34583 2023-10-05 07:01:22,706 DEBUG [StoreOpener-bf55f37d7bd4df8267920a1602f34583-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/cf 2023-10-05 07:01:22,706 DEBUG [StoreOpener-bf55f37d7bd4df8267920a1602f34583-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/cf 2023-10-05 07:01:22,707 INFO [StoreOpener-bf55f37d7bd4df8267920a1602f34583-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf55f37d7bd4df8267920a1602f34583 columnFamilyName cf 2023-10-05 07:01:22,734 DEBUG [StoreOpener-bf55f37d7bd4df8267920a1602f34583-1] regionserver.HStore(539): loaded hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/cf/0367b5af4cb84f4490bb6b69af7d3855.045d08be0eb68081752fb318890e7c9f->hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f/cf/0367b5af4cb84f4490bb6b69af7d3855-top 2023-10-05 07:01:22,739 DEBUG [StoreOpener-bf55f37d7bd4df8267920a1602f34583-1] regionserver.HStore(539): loaded hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/cf/1e6de3fdda1845739076eddca7486fcf.3efaa093538a017206223305dcfbbe34->hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34/cf/1e6de3fdda1845739076eddca7486fcf-top 2023-10-05 07:01:22,740 INFO [StoreOpener-bf55f37d7bd4df8267920a1602f34583-1] regionserver.HStore(310): Store=bf55f37d7bd4df8267920a1602f34583/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:01:22,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583 2023-10-05 07:01:22,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583 2023-10-05 07:01:22,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bf55f37d7bd4df8267920a1602f34583 2023-10-05 07:01:22,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bf55f37d7bd4df8267920a1602f34583; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68267630, jitterRate=0.017266958951950073}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:01:22,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bf55f37d7bd4df8267920a1602f34583: 2023-10-05 07:01:22,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583., pid=77, masterSystemTime=1696489282692 2023-10-05 07:01:22,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583.,because compaction is disabled. 2023-10-05 07:01:22,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583. 2023-10-05 07:01:22,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583. 2023-10-05 07:01:22,748 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=bf55f37d7bd4df8267920a1602f34583, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:22,749 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696489282748"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489282748"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489282748"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489282748"}]},"ts":"1696489282748"} 2023-10-05 07:01:22,752 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-05 07:01:22,752 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure bf55f37d7bd4df8267920a1602f34583, server=jenkins-hbase4.apache.org,39927,1696489208029 in 210 msec 2023-10-05 07:01:22,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-10-05 07:01:22,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bf55f37d7bd4df8267920a1602f34583, ASSIGN in 368 msec 2023-10-05 07:01:22,755 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[3efaa093538a017206223305dcfbbe34, 045d08be0eb68081752fb318890e7c9f], force=true in 705 msec 2023-10-05 07:01:23,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-05 07:01:23,163 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-10-05 07:01:23,164 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 07:01:23,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696489283164 (current time:1696489283164). 2023-10-05 07:01:23,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 07:01:23,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x6dabb160 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:01:23,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14e2fddc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:01:23,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:23,175 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:23,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6dabb160 to 127.0.0.1:58805 2023-10-05 07:01:23,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:01:23,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x3e2fe17c to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:01:23,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ebf7768, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:01:23,185 DEBUG [hconnection-0xd30777e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:23,187 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:23,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:23,194 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:23,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e2fe17c to 127.0.0.1:58805 2023-10-05 07:01:23,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:01:23,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-10-05 07:01:23,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 07:01:23,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 07:01:23,198 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot, current working dir path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 07:01:23,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 07:01:23,200 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 07:01:23,201 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1696489883201 2023-10-05 07:01:23,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-10-05 07:01:23,201 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,204 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 07:01:23,204 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 07:01:23,205 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-10-05 07:01:23,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 07:01:23,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 6 msec 2023-10-05 07:01:23,207 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 07:01:23,207 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1696489883207 2023-10-05 07:01:23,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,216 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-10-05 07:01:23,216 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:23,217 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-10-05 07:01:23,217 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-10-05 07:01:23,218 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,218 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,220 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:23,221 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:23,221 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:23,220 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:23,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:23,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:23,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:23,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:23,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:23,221 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,221 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 07:01:23,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 07:01:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 07:01:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,222 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 07:01:23,222 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 07:01:23,222 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,222 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,223 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 07:01:23,223 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 07:01:23,223 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:23,223 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:23,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-10-05 07:01:23,225 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 07:01:23,225 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 07:01:23,224 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 07:01:23,225 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 07:01:23,225 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 07:01:23,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,225 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 07:01:23,225 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-10-05 07:01:23,225 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,225 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-10-05 07:01:23,225 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:23,226 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-10-05 07:01:23,226 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-10-05 07:01:23,226 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-10-05 07:01:23,228 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,228 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:23,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:23,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:23,230 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,230 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:23,230 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,231 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,231 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,231 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:23,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:23,231 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,231 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:23,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:23,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:23,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:23,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-10-05 07:01:23,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50e6cbc9[Count = 0] remaining members to acquire global barrier 2023-10-05 07:01:23,233 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-10-05 07:01:23,233 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,234 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,234 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,234 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,234 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 07:01:23,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,234 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 07:01:23,234 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,234 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 07:01:23,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,234 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35011,1696489207914' in zk 2023-10-05 07:01:23,234 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 07:01:23,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,235 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-10-05 07:01:23,235 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 07:01:23,235 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33577,1696489207986' in zk 2023-10-05 07:01:23,235 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:01:23,235 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:01:23,235 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583. 2023-10-05 07:01:23,235 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583. started... 2023-10-05 07:01:23,236 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bf55f37d7bd4df8267920a1602f34583: 2023-10-05 07:01:23,236 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,236 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:01:23,237 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/cf/0367b5af4cb84f4490bb6b69af7d3855.045d08be0eb68081752fb318890e7c9f->hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f/cf/0367b5af4cb84f4490bb6b69af7d3855-top, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/cf/1e6de3fdda1845739076eddca7486fcf.3efaa093538a017206223305dcfbbe34->hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34/cf/1e6de3fdda1845739076eddca7486fcf-top] hfiles 2023-10-05 07:01:23,237 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/cf/0367b5af4cb84f4490bb6b69af7d3855.045d08be0eb68081752fb318890e7c9f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,237 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 07:01:23,237 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:23,237 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 07:01:23,238 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/cf/1e6de3fdda1845739076eddca7486fcf.3efaa093538a017206223305dcfbbe34 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,238 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 07:01:23,238 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:23,238 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 07:01:23,248 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583. completed. 2023-10-05 07:01:23,248 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583. 2023-10-05 07:01:23,248 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:01:23,249 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:01:23,249 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,249 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-10-05 07:01:23,249 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39927,1696489208029' in zk 2023-10-05 07:01:23,258 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,258 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-10-05 07:01:23,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:23,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:23,258 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:23,258 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-10-05 07:01:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:23,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,39927,1696489208029': 2023-10-05 07:01:23,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-10-05 07:01:23,261 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-10-05 07:01:23,261 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 07:01:23,261 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 07:01:23,261 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,261 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 07:01:23,264 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,264 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,264 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,264 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,264 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:23,264 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:23,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,264 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:23,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:23,264 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:23,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:23,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:23,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:23,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:23,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:23,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:23,265 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:23,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:23,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,266 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:23,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:23,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:23,267 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:23,268 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:23,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,268 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:23,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:23,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,270 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:23,270 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:23,270 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:23,270 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:23,270 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:23,270 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:23,271 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,270 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:23,270 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:23,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,270 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:23,270 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:23,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:23,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:23,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:23,271 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:23,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:23,271 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,271 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:23,271 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,271 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:23,271 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:23,271 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,271 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:23,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:23,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:23,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:23,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:23,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:23,292 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,293 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-10-05 07:01:23,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,294 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1696489283201Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696489283271 (+70 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696489283271Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696489283274 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1696489283285 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1696489283293 (+8 ms) 2023-10-05 07:01:23,296 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-10-05 07:01:23,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 93 msec 2023-10-05 07:01:23,304 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:01:23,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-10-05 07:01:23,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 07:01:23,306 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489283306 2023-10-05 07:01:23,306 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41859, tgtDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489283306, rawTgtDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489283306, srcFsUri=hdfs://localhost:41859, srcDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:01:23,327 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41859, inputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:01:23,328 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1098361790_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489283306, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489283306/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,328 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41859, inputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0, snapshotDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-10-05 07:01:23,336 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489283306/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:23,352 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:23,352 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:23,352 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:23,353 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:23,901 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0004_000001 (auth:SIMPLE) 2023-10-05 07:01:24,243 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop-5905869955741794803.jar 2023-10-05 07:01:24,243 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:24,244 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:24,310 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop-6762109428730648284.jar 2023-10-05 07:01:24,310 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:24,311 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:24,311 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:24,312 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:24,312 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:24,312 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:24,313 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 07:01:24,313 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 07:01:24,313 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 07:01:24,314 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 07:01:24,314 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 07:01:24,314 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 07:01:24,315 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 07:01:24,315 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 07:01:24,315 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 07:01:24,316 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 07:01:24,316 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:01:24,317 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:01:24,317 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:01:24,318 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:01:24,318 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:01:24,318 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:01:24,319 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:01:24,674 WARN [Listener at jenkins-hbase4.apache.org/36167] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 07:01:24,676 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-10-05 07:01:24,678 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-10-05 07:01:24,736 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 07:01:24,736 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 07:01:24,906 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0005_000001 (auth:SIMPLE) 2023-10-05 07:01:25,333 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 07:01:28,693 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0005_000001 (auth:SIMPLE) 2023-10-05 07:01:30,905 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0005_000001 (auth:SIMPLE) 2023-10-05 07:01:33,215 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0005_000001 (auth:SIMPLE) 2023-10-05 07:01:34,893 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 07:01:34,896 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 07:01:34,906 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:34,906 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 07:01:34,906 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 07:01:34,906 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740582836_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:34,907 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-05 07:01:34,907 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-05 07:01:34,907 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740582836_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489283306/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489283306/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:34,908 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489283306/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-10-05 07:01:34,908 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489283306/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-10-05 07:01:34,914 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:34,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:34,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:34,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 07:01:34,919 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489294919"}]},"ts":"1696489294919"} 2023-10-05 07:01:34,920 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-10-05 07:01:34,921 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-10-05 07:01:34,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bf55f37d7bd4df8267920a1602f34583, UNASSIGN}] 2023-10-05 07:01:34,924 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bf55f37d7bd4df8267920a1602f34583, UNASSIGN 2023-10-05 07:01:34,925 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=bf55f37d7bd4df8267920a1602f34583, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:34,925 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696489294925"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489294925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489294925"}]},"ts":"1696489294925"} 2023-10-05 07:01:34,926 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure bf55f37d7bd4df8267920a1602f34583, server=jenkins-hbase4.apache.org,39927,1696489208029}] 2023-10-05 07:01:35,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 07:01:35,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bf55f37d7bd4df8267920a1602f34583 2023-10-05 07:01:35,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bf55f37d7bd4df8267920a1602f34583, disabling compactions & flushes 2023-10-05 07:01:35,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583. 2023-10-05 07:01:35,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583. 2023-10-05 07:01:35,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583. after waiting 0 ms 2023-10-05 07:01:35,078 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583. 2023-10-05 07:01:35,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-10-05 07:01:35,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:01:35,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583. 2023-10-05 07:01:35,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bf55f37d7bd4df8267920a1602f34583: 2023-10-05 07:01:35,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bf55f37d7bd4df8267920a1602f34583 2023-10-05 07:01:35,092 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=bf55f37d7bd4df8267920a1602f34583, regionState=CLOSED 2023-10-05 07:01:35,092 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1696489295092"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489295092"}]},"ts":"1696489295092"} 2023-10-05 07:01:35,095 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-10-05 07:01:35,095 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure bf55f37d7bd4df8267920a1602f34583, server=jenkins-hbase4.apache.org,39927,1696489208029 in 167 msec 2023-10-05 07:01:35,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-10-05 07:01:35,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bf55f37d7bd4df8267920a1602f34583, UNASSIGN in 173 msec 2023-10-05 07:01:35,097 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489295097"}]},"ts":"1696489295097"} 2023-10-05 07:01:35,098 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-10-05 07:01:35,099 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-10-05 07:01:35,101 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 186 msec 2023-10-05 07:01:35,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-10-05 07:01:35,221 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-10-05 07:01:35,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,225 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,226 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,227 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39927] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,230 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583 2023-10-05 07:01:35,230 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34 2023-10-05 07:01:35,230 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f 2023-10-05 07:01:35,230 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,231 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,231 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,231 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 07:01:35,231 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 07:01:35,232 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-10-05 07:01:35,232 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/cf, FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/recovered.edits] 2023-10-05 07:01:35,232 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f/cf, FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f/recovered.edits] 2023-10-05 07:01:35,232 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:35,232 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,232 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,232 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:35,232 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,232 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:35,232 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-10-05 07:01:35,233 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34/cf, FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34/recovered.edits] 2023-10-05 07:01:35,232 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:35,233 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 07:01:35,233 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:35,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-05 07:01:35,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:35,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:35,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:35,238 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34/cf/1e6de3fdda1845739076eddca7486fcf to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34/cf/1e6de3fdda1845739076eddca7486fcf 2023-10-05 07:01:35,238 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f/cf/0367b5af4cb84f4490bb6b69af7d3855 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f/cf/0367b5af4cb84f4490bb6b69af7d3855 2023-10-05 07:01:35,238 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/cf/0367b5af4cb84f4490bb6b69af7d3855.045d08be0eb68081752fb318890e7c9f to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/cf/0367b5af4cb84f4490bb6b69af7d3855.045d08be0eb68081752fb318890e7c9f 2023-10-05 07:01:35,240 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/cf/1e6de3fdda1845739076eddca7486fcf.3efaa093538a017206223305dcfbbe34 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/cf/1e6de3fdda1845739076eddca7486fcf.3efaa093538a017206223305dcfbbe34 2023-10-05 07:01:35,241 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34/recovered.edits/8.seqid to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34/recovered.edits/8.seqid 2023-10-05 07:01:35,241 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f/recovered.edits/8.seqid to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f/recovered.edits/8.seqid 2023-10-05 07:01:35,242 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/3efaa093538a017206223305dcfbbe34 2023-10-05 07:01:35,242 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/045d08be0eb68081752fb318890e7c9f 2023-10-05 07:01:35,243 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/recovered.edits/12.seqid to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583/recovered.edits/12.seqid 2023-10-05 07:01:35,243 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bf55f37d7bd4df8267920a1602f34583 2023-10-05 07:01:35,243 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-10-05 07:01:35,245 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,247 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-10-05 07:01:35,249 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-10-05 07:01:35,250 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,250 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-10-05 07:01:35,250 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696489295250"}]},"ts":"9223372036854775807"} 2023-10-05 07:01:35,252 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-05 07:01:35,252 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bf55f37d7bd4df8267920a1602f34583, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1696489281413.bf55f37d7bd4df8267920a1602f34583.', STARTKEY => '', ENDKEY => ''}] 2023-10-05 07:01:35,252 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-10-05 07:01:35,252 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696489295252"}]},"ts":"9223372036854775807"} 2023-10-05 07:01:35,253 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-10-05 07:01:35,255 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,256 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 33 msec 2023-10-05 07:01:35,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-10-05 07:01:35,335 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-10-05 07:01:35,336 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 07:01:35,340 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489295340"}]},"ts":"1696489295340"} 2023-10-05 07:01:35,342 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-10-05 07:01:35,343 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-10-05 07:01:35,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b7df7d096f54accaf1115e76ba16572f, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02485a41c30f5b9d17ab2fa0704542a3, UNASSIGN}] 2023-10-05 07:01:35,346 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b7df7d096f54accaf1115e76ba16572f, UNASSIGN 2023-10-05 07:01:35,346 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02485a41c30f5b9d17ab2fa0704542a3, UNASSIGN 2023-10-05 07:01:35,347 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=b7df7d096f54accaf1115e76ba16572f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:35,347 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=02485a41c30f5b9d17ab2fa0704542a3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:35,347 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696489295346"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489295346"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489295346"}]},"ts":"1696489295346"} 2023-10-05 07:01:35,347 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696489295346"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489295346"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489295346"}]},"ts":"1696489295346"} 2023-10-05 07:01:35,348 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure b7df7d096f54accaf1115e76ba16572f, server=jenkins-hbase4.apache.org,33577,1696489207986}] 2023-10-05 07:01:35,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 02485a41c30f5b9d17ab2fa0704542a3, server=jenkins-hbase4.apache.org,39927,1696489208029}] 2023-10-05 07:01:35,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 07:01:35,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b7df7d096f54accaf1115e76ba16572f 2023-10-05 07:01:35,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b7df7d096f54accaf1115e76ba16572f, disabling compactions & flushes 2023-10-05 07:01:35,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:35,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:35,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. after waiting 0 ms 2023-10-05 07:01:35,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:35,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 02485a41c30f5b9d17ab2fa0704542a3 2023-10-05 07:01:35,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 02485a41c30f5b9d17ab2fa0704542a3, disabling compactions & flushes 2023-10-05 07:01:35,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. 2023-10-05 07:01:35,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. 2023-10-05 07:01:35,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. after waiting 0 ms 2023-10-05 07:01:35,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. 2023-10-05 07:01:35,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 07:01:35,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 07:01:35,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:01:35,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3. 2023-10-05 07:01:35,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:01:35,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 02485a41c30f5b9d17ab2fa0704542a3: 2023-10-05 07:01:35,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f. 2023-10-05 07:01:35,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b7df7d096f54accaf1115e76ba16572f: 2023-10-05 07:01:35,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 02485a41c30f5b9d17ab2fa0704542a3 2023-10-05 07:01:35,518 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=02485a41c30f5b9d17ab2fa0704542a3, regionState=CLOSED 2023-10-05 07:01:35,518 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696489295518"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489295518"}]},"ts":"1696489295518"} 2023-10-05 07:01:35,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b7df7d096f54accaf1115e76ba16572f 2023-10-05 07:01:35,519 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=b7df7d096f54accaf1115e76ba16572f, regionState=CLOSED 2023-10-05 07:01:35,519 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1696489295519"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489295519"}]},"ts":"1696489295519"} 2023-10-05 07:01:35,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-10-05 07:01:35,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 02485a41c30f5b9d17ab2fa0704542a3, server=jenkins-hbase4.apache.org,39927,1696489208029 in 171 msec 2023-10-05 07:01:35,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-10-05 07:01:35,522 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure b7df7d096f54accaf1115e76ba16572f, server=jenkins-hbase4.apache.org,33577,1696489207986 in 172 msec 2023-10-05 07:01:35,522 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=02485a41c30f5b9d17ab2fa0704542a3, UNASSIGN in 177 msec 2023-10-05 07:01:35,523 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-10-05 07:01:35,523 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b7df7d096f54accaf1115e76ba16572f, UNASSIGN in 178 msec 2023-10-05 07:01:35,523 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489295523"}]},"ts":"1696489295523"} 2023-10-05 07:01:35,524 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-10-05 07:01:35,527 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-10-05 07:01:35,529 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 192 msec 2023-10-05 07:01:35,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-10-05 07:01:35,643 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-10-05 07:01:35,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,647 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,647 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,648 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39927] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,651 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,651 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f 2023-10-05 07:01:35,651 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3 2023-10-05 07:01:35,651 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,651 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,651 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,652 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 07:01:35,652 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-10-05 07:01:35,653 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,653 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:35,653 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-10-05 07:01:35,653 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,653 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 07:01:35,653 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:35,653 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:35,653 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:35,653 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-10-05 07:01:35,653 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-10-05 07:01:35,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-05 07:01:35,654 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f/cf, FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f/recovered.edits] 2023-10-05 07:01:35,654 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3/cf, FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3/recovered.edits] 2023-10-05 07:01:35,658 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f/cf/763a0d53dc834cb39d3739f078fbce81 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f/cf/763a0d53dc834cb39d3739f078fbce81 2023-10-05 07:01:35,658 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3/cf/dedd1d41b98e46b3ab6a5fc6c3b75e45 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3/cf/dedd1d41b98e46b3ab6a5fc6c3b75e45 2023-10-05 07:01:35,661 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f/recovered.edits/9.seqid to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f/recovered.edits/9.seqid 2023-10-05 07:01:35,661 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3/recovered.edits/9.seqid to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3/recovered.edits/9.seqid 2023-10-05 07:01:35,661 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b7df7d096f54accaf1115e76ba16572f 2023-10-05 07:01:35,662 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/02485a41c30f5b9d17ab2fa0704542a3 2023-10-05 07:01:35,662 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-10-05 07:01:35,662 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-05 07:01:35,663 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-10-05 07:01:35,665 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231005b8cf85977bfb45a48048979669ace7c8 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20231005b8cf85977bfb45a48048979669ace7c8 2023-10-05 07:01:35,667 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310058ab173b5f4a04b5695c8c2abda6702e5 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202310058ab173b5f4a04b5695c8c2abda6702e5 2023-10-05 07:01:35,667 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-10-05 07:01:35,669 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,671 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-10-05 07:01:35,673 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-10-05 07:01:35,674 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,674 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-10-05 07:01:35,674 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696489295674"}]},"ts":"9223372036854775807"} 2023-10-05 07:01:35,674 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696489295674"}]},"ts":"9223372036854775807"} 2023-10-05 07:01:35,675 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 07:01:35,675 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b7df7d096f54accaf1115e76ba16572f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1696489280044.b7df7d096f54accaf1115e76ba16572f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 02485a41c30f5b9d17ab2fa0704542a3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1696489280044.02485a41c30f5b9d17ab2fa0704542a3.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 07:01:35,675 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-10-05 07:01:35,676 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696489295675"}]},"ts":"9223372036854775807"} 2023-10-05 07:01:35,677 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-10-05 07:01:35,679 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,680 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 36 msec 2023-10-05 07:01:35,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-10-05 07:01:35,756 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-10-05 07:01:35,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-05 07:01:35,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-10-05 07:01:35,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-10-05 07:01:35,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-10-05 07:01:35,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-10-05 07:01:35,797 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 746) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740582836_17 at /127.0.0.1:58096 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:33053 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740582836_17 at /127.0.0.1:39218 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1460401263_1 at /127.0.0.1:41690 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3958 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740582836_17 at /127.0.0.1:41710 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=185 (was 221), ProcessCount=168 (was 168), AvailableMemoryMB=5792 (was 5848) 2023-10-05 07:01:35,797 WARN [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-10-05 07:01:35,817 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=185, ProcessCount=168, AvailableMemoryMB=5791 2023-10-05 07:01:35,817 WARN [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-10-05 07:01:35,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 07:01:35,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 07:01:35,822 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 07:01:35,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-10-05 07:01:35,823 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 07:01:35,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 07:01:35,825 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb 2023-10-05 07:01:35,825 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd 2023-10-05 07:01:35,826 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb empty. 2023-10-05 07:01:35,826 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd empty. 2023-10-05 07:01:35,826 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb 2023-10-05 07:01:35,826 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd 2023-10-05 07:01:35,826 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-05 07:01:35,835 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-10-05 07:01:35,836 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 409d7b62c55dcb2fa5294fdc29a256bd, NAME => 'testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp 2023-10-05 07:01:35,836 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8a5c50a5a7e0cced616a5d49282ac0eb, NAME => 'testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp 2023-10-05 07:01:35,871 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:35,871 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:35,871 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 8a5c50a5a7e0cced616a5d49282ac0eb, disabling compactions & flushes 2023-10-05 07:01:35,871 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 409d7b62c55dcb2fa5294fdc29a256bd, disabling compactions & flushes 2023-10-05 07:01:35,871 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:35,871 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. 2023-10-05 07:01:35,871 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:35,871 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. 2023-10-05 07:01:35,871 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. after waiting 0 ms 2023-10-05 07:01:35,871 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. after waiting 0 ms 2023-10-05 07:01:35,871 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. 2023-10-05 07:01:35,871 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:35,871 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. 2023-10-05 07:01:35,871 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:35,871 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 8a5c50a5a7e0cced616a5d49282ac0eb: 2023-10-05 07:01:35,871 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 409d7b62c55dcb2fa5294fdc29a256bd: 2023-10-05 07:01:35,873 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 07:01:35,874 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696489295874"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489295874"}]},"ts":"1696489295874"} 2023-10-05 07:01:35,874 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696489295874"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489295874"}]},"ts":"1696489295874"} 2023-10-05 07:01:35,876 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 07:01:35,877 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 07:01:35,877 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489295877"}]},"ts":"1696489295877"} 2023-10-05 07:01:35,878 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-10-05 07:01:35,881 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 07:01:35,882 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 07:01:35,882 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 07:01:35,882 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 07:01:35,882 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 07:01:35,883 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a5c50a5a7e0cced616a5d49282ac0eb, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=409d7b62c55dcb2fa5294fdc29a256bd, ASSIGN}] 2023-10-05 07:01:35,885 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=409d7b62c55dcb2fa5294fdc29a256bd, ASSIGN 2023-10-05 07:01:35,885 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a5c50a5a7e0cced616a5d49282ac0eb, ASSIGN 2023-10-05 07:01:35,886 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=409d7b62c55dcb2fa5294fdc29a256bd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39927,1696489208029; forceNewPlan=false, retain=false 2023-10-05 07:01:35,886 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a5c50a5a7e0cced616a5d49282ac0eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35011,1696489207914; forceNewPlan=false, retain=false 2023-10-05 07:01:35,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 07:01:36,036 INFO [jenkins-hbase4:33507] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 07:01:36,039 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=409d7b62c55dcb2fa5294fdc29a256bd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,039 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8a5c50a5a7e0cced616a5d49282ac0eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,039 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696489296039"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489296039"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489296039"}]},"ts":"1696489296039"} 2023-10-05 07:01:36,039 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696489296039"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489296039"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489296039"}]},"ts":"1696489296039"} 2023-10-05 07:01:36,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 409d7b62c55dcb2fa5294fdc29a256bd, server=jenkins-hbase4.apache.org,39927,1696489208029}] 2023-10-05 07:01:36,041 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 8a5c50a5a7e0cced616a5d49282ac0eb, server=jenkins-hbase4.apache.org,35011,1696489207914}] 2023-10-05 07:01:36,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 07:01:36,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. 2023-10-05 07:01:36,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 409d7b62c55dcb2fa5294fdc29a256bd, NAME => 'testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 07:01:36,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. service=AccessControlService 2023-10-05 07:01:36,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:01:36,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 409d7b62c55dcb2fa5294fdc29a256bd 2023-10-05 07:01:36,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:36,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:36,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 409d7b62c55dcb2fa5294fdc29a256bd 2023-10-05 07:01:36,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 409d7b62c55dcb2fa5294fdc29a256bd 2023-10-05 07:01:36,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8a5c50a5a7e0cced616a5d49282ac0eb, NAME => 'testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 07:01:36,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. service=AccessControlService 2023-10-05 07:01:36,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:01:36,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8a5c50a5a7e0cced616a5d49282ac0eb 2023-10-05 07:01:36,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:36,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8a5c50a5a7e0cced616a5d49282ac0eb 2023-10-05 07:01:36,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8a5c50a5a7e0cced616a5d49282ac0eb 2023-10-05 07:01:36,201 INFO [StoreOpener-409d7b62c55dcb2fa5294fdc29a256bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 409d7b62c55dcb2fa5294fdc29a256bd 2023-10-05 07:01:36,202 INFO [StoreOpener-8a5c50a5a7e0cced616a5d49282ac0eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8a5c50a5a7e0cced616a5d49282ac0eb 2023-10-05 07:01:36,203 DEBUG [StoreOpener-409d7b62c55dcb2fa5294fdc29a256bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd/cf 2023-10-05 07:01:36,203 DEBUG [StoreOpener-409d7b62c55dcb2fa5294fdc29a256bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd/cf 2023-10-05 07:01:36,203 DEBUG [StoreOpener-8a5c50a5a7e0cced616a5d49282ac0eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb/cf 2023-10-05 07:01:36,203 DEBUG [StoreOpener-8a5c50a5a7e0cced616a5d49282ac0eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb/cf 2023-10-05 07:01:36,203 INFO [StoreOpener-409d7b62c55dcb2fa5294fdc29a256bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 409d7b62c55dcb2fa5294fdc29a256bd columnFamilyName cf 2023-10-05 07:01:36,203 INFO [StoreOpener-8a5c50a5a7e0cced616a5d49282ac0eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a5c50a5a7e0cced616a5d49282ac0eb columnFamilyName cf 2023-10-05 07:01:36,204 INFO [StoreOpener-409d7b62c55dcb2fa5294fdc29a256bd-1] regionserver.HStore(310): Store=409d7b62c55dcb2fa5294fdc29a256bd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:01:36,204 INFO [StoreOpener-8a5c50a5a7e0cced616a5d49282ac0eb-1] regionserver.HStore(310): Store=8a5c50a5a7e0cced616a5d49282ac0eb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:01:36,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd 2023-10-05 07:01:36,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb 2023-10-05 07:01:36,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd 2023-10-05 07:01:36,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb 2023-10-05 07:01:36,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 409d7b62c55dcb2fa5294fdc29a256bd 2023-10-05 07:01:36,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8a5c50a5a7e0cced616a5d49282ac0eb 2023-10-05 07:01:36,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:01:36,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:01:36,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 409d7b62c55dcb2fa5294fdc29a256bd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69043662, jitterRate=0.028830736875534058}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:01:36,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 409d7b62c55dcb2fa5294fdc29a256bd: 2023-10-05 07:01:36,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8a5c50a5a7e0cced616a5d49282ac0eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58781254, jitterRate=-0.12409105896949768}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:01:36,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8a5c50a5a7e0cced616a5d49282ac0eb: 2023-10-05 07:01:36,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb., pid=94, masterSystemTime=1696489296194 2023-10-05 07:01:36,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd., pid=93, masterSystemTime=1696489296192 2023-10-05 07:01:36,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:36,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:36,213 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8a5c50a5a7e0cced616a5d49282ac0eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. 2023-10-05 07:01:36,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. 2023-10-05 07:01:36,213 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696489296213"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489296213"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489296213"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489296213"}]},"ts":"1696489296213"} 2023-10-05 07:01:36,213 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=409d7b62c55dcb2fa5294fdc29a256bd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,214 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696489296213"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489296213"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489296213"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489296213"}]},"ts":"1696489296213"} 2023-10-05 07:01:36,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-10-05 07:01:36,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 8a5c50a5a7e0cced616a5d49282ac0eb, server=jenkins-hbase4.apache.org,35011,1696489207914 in 173 msec 2023-10-05 07:01:36,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-10-05 07:01:36,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 409d7b62c55dcb2fa5294fdc29a256bd, server=jenkins-hbase4.apache.org,39927,1696489208029 in 174 msec 2023-10-05 07:01:36,217 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a5c50a5a7e0cced616a5d49282ac0eb, ASSIGN in 333 msec 2023-10-05 07:01:36,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-10-05 07:01:36,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=409d7b62c55dcb2fa5294fdc29a256bd, ASSIGN in 334 msec 2023-10-05 07:01:36,219 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 07:01:36,219 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489296219"}]},"ts":"1696489296219"} 2023-10-05 07:01:36,220 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-10-05 07:01:36,222 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 07:01:36,223 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-10-05 07:01:36,224 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39927] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 07:01:36,226 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:36,226 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:36,226 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:36,226 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:36,228 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:36,228 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:36,228 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:36,228 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:36,229 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 409 msec 2023-10-05 07:01:36,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-10-05 07:01:36,427 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-10-05 07:01:36,429 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-05 07:01:36,429 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:36,431 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 07:01:36,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 07:01:36,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696489296442 (current time:1696489296442). 2023-10-05 07:01:36,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 07:01:36,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x735d1bec to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:01:36,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68de6be7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:01:36,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:36,455 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:36,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x735d1bec to 127.0.0.1:58805 2023-10-05 07:01:36,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:01:36,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x60d7fb87 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:01:36,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b4e1e0a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:01:36,464 DEBUG [hconnection-0x60d4d3d7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:36,466 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:36,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:36,470 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:36,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60d7fb87 to 127.0.0.1:58805 2023-10-05 07:01:36,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:01:36,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 07:01:36,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 07:01:36,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 07:01:36,474 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot, current working dir path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 07:01:36,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 07:01:36,479 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 07:01:36,480 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696489896480 2023-10-05 07:01:36,480 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-05 07:01:36,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 07:01:36,481 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 07:01:36,482 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 07:01:36,482 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 07:01:36,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 07:01:36,483 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-05 07:01:36,486 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 07:01:36,486 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696489896486 2023-10-05 07:01:36,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,495 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-10-05 07:01:36,495 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:36,496 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-05 07:01:36,496 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-05 07:01:36,496 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,497 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,503 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:36,503 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:36,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:36,503 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,503 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:36,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:36,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:36,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:36,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:36,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:36,504 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,504 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,504 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,504 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 07:01:36,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 07:01:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 07:01:36,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-10-05 07:01:36,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,505 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 07:01:36,505 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 07:01:36,505 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 07:01:36,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,505 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 07:01:36,505 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 07:01:36,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,505 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:36,505 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:36,505 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 07:01:36,507 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 07:01:36,508 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 07:01:36,508 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 07:01:36,508 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 07:01:36,507 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:36,508 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 07:01:36,508 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 07:01:36,509 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 07:01:36,509 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 07:01:36,509 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 07:01:36,512 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,513 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,513 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:36,514 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,514 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:36,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:36,514 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,515 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:36,515 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,515 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:36,515 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:36,515 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:36,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:36,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 07:01:36,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b295865[Count = 1] remaining members to acquire global barrier 2023-10-05 07:01:36,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:36,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:36,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:36,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:36,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:36,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 07:01:36,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b295865[Count = 0] remaining members to acquire global barrier 2023-10-05 07:01:36,519 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 07:01:36,519 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,520 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,520 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,520 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,520 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,520 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 07:01:36,520 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 07:01:36,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,521 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 07:01:36,521 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 07:01:36,521 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:01:36,521 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,521 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 07:01:36,521 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:01:36,521 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:01:36,521 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:01:36,521 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33577,1696489207986' in zk 2023-10-05 07:01:36,521 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. 2023-10-05 07:01:36,521 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:36,521 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. started... 2023-10-05 07:01:36,521 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. started... 2023-10-05 07:01:36,523 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a5c50a5a7e0cced616a5d49282ac0eb: 2023-10-05 07:01:36,523 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 409d7b62c55dcb2fa5294fdc29a256bd: 2023-10-05 07:01:36,523 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,523 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,523 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:01:36,523 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:01:36,523 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 07:01:36,523 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 07:01:36,525 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 07:01:36,525 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:36,525 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 07:01:36,534 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. completed. 2023-10-05 07:01:36,535 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:36,535 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:01:36,535 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:01:36,535 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. completed. 2023-10-05 07:01:36,535 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. 2023-10-05 07:01:36,535 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,535 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:01:36,535 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:01:36,535 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,535 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 07:01:36,535 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 07:01:36,535 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35011,1696489207914' in zk 2023-10-05 07:01:36,535 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39927,1696489208029' in zk 2023-10-05 07:01:36,537 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 07:01:36,537 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 07:01:36,537 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:36,537 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:36,537 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 07:01:36,539 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,539 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 07:01:36,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:36,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:36,540 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:36,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:36,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:36,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35011,1696489207914': 2023-10-05 07:01:36,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 07:01:36,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:36,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:36,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:36,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39927,1696489208029': 2023-10-05 07:01:36,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 07:01:36,546 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-10-05 07:01:36,546 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 07:01:36,546 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 07:01:36,546 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,546 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 07:01:36,548 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,548 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,548 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:36,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,548 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,548 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,548 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:36,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:36,549 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,548 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:36,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:36,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:36,549 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:36,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,550 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:36,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,551 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:36,551 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,552 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,554 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,554 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,554 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:36,554 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:36,554 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:36,554 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:36,555 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:36,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:36,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:36,555 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,555 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:36,556 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-05 07:01:36,555 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:36,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:36,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:36,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:36,555 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:36,555 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:36,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:36,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,557 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 07:01:36,557 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:36,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:36,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:36,557 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:36,557 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,557 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,557 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,557 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 07:01:36,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,582 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:01:36,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,583 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-05 07:01:36,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 07:01:36,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 07:01:36,583 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696489296480Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696489296567 (+87 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696489296567Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1696489296567Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1696489296570 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1696489296577 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696489296583 (+6 ms) 2023-10-05 07:01:36,586 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 07:01:36,588 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 105 msec 2023-10-05 07:01:36,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35011] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 07:01:36,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39927] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 07:01:36,592 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-10-05 07:01:36,592 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:36,592 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 07:01:36,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 07:01:36,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696489296601 (current time:1696489296601). 2023-10-05 07:01:36,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 07:01:36,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x6499660e to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:01:36,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63b4185f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:01:36,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:36,613 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:36,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6499660e to 127.0.0.1:58805 2023-10-05 07:01:36,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:01:36,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x44ce4307 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:01:36,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6bc8e486, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:01:36,622 DEBUG [hconnection-0x28fd7f40-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:36,623 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:36,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:36,630 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:36,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44ce4307 to 127.0.0.1:58805 2023-10-05 07:01:36,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:01:36,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-10-05 07:01:36,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 07:01:36,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 07:01:36,634 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot, current working dir path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 07:01:36,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 07:01:36,636 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 07:01:36,637 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1696489896637 2023-10-05 07:01:36,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-10-05 07:01:36,637 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-10-05 07:01:36,638 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 07:01:36,638 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 07:01:36,639 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-10-05 07:01:36,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 07:01:36,640 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-10-05 07:01:36,640 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 07:01:36,641 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1696489896641 2023-10-05 07:01:36,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,649 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-10-05 07:01:36,649 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:36,650 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-10-05 07:01:36,650 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-10-05 07:01:36,651 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,651 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,653 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:36,653 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:36,653 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,653 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:36,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:36,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:36,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:36,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:36,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:36,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:36,654 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,654 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,654 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,654 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 07:01:36,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 07:01:36,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 07:01:36,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-10-05 07:01:36,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,655 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 07:01:36,655 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 07:01:36,655 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-10-05 07:01:36,655 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,655 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,655 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 07:01:36,655 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 07:01:36,655 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:36,655 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:36,655 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,657 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 07:01:36,657 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-10-05 07:01:36,657 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:36,656 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 07:01:36,660 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-10-05 07:01:36,660 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 07:01:36,660 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 07:01:36,657 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 07:01:36,660 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-10-05 07:01:36,661 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 07:01:36,661 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-10-05 07:01:36,663 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,663 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,663 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:36,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:36,664 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,664 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,664 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:36,664 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:36,664 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,664 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:36,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:36,665 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,665 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:36,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:36,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 07:01:36,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@509108fa[Count = 1] remaining members to acquire global barrier 2023-10-05 07:01:36,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:36,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:36,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:36,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:36,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:36,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-10-05 07:01:36,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@509108fa[Count = 0] remaining members to acquire global barrier 2023-10-05 07:01:36,668 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-10-05 07:01:36,668 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,673 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,673 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,673 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,673 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 07:01:36,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,673 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,674 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 07:01:36,674 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 07:01:36,674 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33577,1696489207986' in zk 2023-10-05 07:01:36,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,674 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-10-05 07:01:36,674 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:01:36,674 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,674 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 07:01:36,674 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. 2023-10-05 07:01:36,674 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:01:36,674 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:01:36,674 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:36,674 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:01:36,674 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. started... 2023-10-05 07:01:36,674 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. started... 2023-10-05 07:01:36,674 INFO [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8a5c50a5a7e0cced616a5d49282ac0eb 1/1 column families, dataSize=199 B heapSize=688 B 2023-10-05 07:01:36,674 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 409d7b62c55dcb2fa5294fdc29a256bd 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-10-05 07:01:36,675 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 07:01:36,675 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:36,675 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 07:01:36,692 INFO [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231005a143dcf9e9804b27bf945b01b2d92d44 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005a143dcf9e9804b27bf945b01b2d92d44 2023-10-05 07:01:36,692 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231005c8cf73a2a8524f51ba03c93a8f4ec0ff to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231005c8cf73a2a8524f51ba03c93a8f4ec0ff 2023-10-05 07:01:36,700 INFO [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb/.tmp/cf/81b022efaa2a4f029b3a362e852d990b 2023-10-05 07:01:36,700 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd/.tmp/cf/5925878d555947bd9161f516e83f5e6a 2023-10-05 07:01:36,706 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd/.tmp/cf/5925878d555947bd9161f516e83f5e6a as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd/cf/5925878d555947bd9161f516e83f5e6a 2023-10-05 07:01:36,706 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb/.tmp/cf/81b022efaa2a4f029b3a362e852d990b as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb/cf/81b022efaa2a4f029b3a362e852d990b 2023-10-05 07:01:36,711 INFO [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb/cf/81b022efaa2a4f029b3a362e852d990b, entries=3, sequenceid=6, filesize=5.4 K 2023-10-05 07:01:36,711 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd/cf/5925878d555947bd9161f516e83f5e6a, entries=47, sequenceid=6, filesize=13.1 K 2023-10-05 07:01:36,712 INFO [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 8a5c50a5a7e0cced616a5d49282ac0eb in 38ms, sequenceid=6, compaction requested=false 2023-10-05 07:01:36,712 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-05 07:01:36,712 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 409d7b62c55dcb2fa5294fdc29a256bd in 38ms, sequenceid=6, compaction requested=false 2023-10-05 07:01:36,712 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-10-05 07:01:36,715 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a5c50a5a7e0cced616a5d49282ac0eb: 2023-10-05 07:01:36,715 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 409d7b62c55dcb2fa5294fdc29a256bd: 2023-10-05 07:01:36,715 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,715 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,715 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:01:36,716 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:01:36,716 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb/cf/81b022efaa2a4f029b3a362e852d990b] hfiles 2023-10-05 07:01:36,716 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd/cf/5925878d555947bd9161f516e83f5e6a] hfiles 2023-10-05 07:01:36,716 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb/cf/81b022efaa2a4f029b3a362e852d990b for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,716 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd/cf/5925878d555947bd9161f516e83f5e6a for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,724 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. completed. 2023-10-05 07:01:36,724 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. 2023-10-05 07:01:36,724 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:01:36,724 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:01:36,724 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,724 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 07:01:36,724 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39927,1696489208029' in zk 2023-10-05 07:01:36,725 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. completed. 2023-10-05 07:01:36,725 DEBUG [rs(jenkins-hbase4.apache.org,35011,1696489207914)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:36,725 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:01:36,725 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:01:36,725 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,725 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-10-05 07:01:36,725 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35011,1696489207914' in zk 2023-10-05 07:01:36,726 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,726 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 07:01:36,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:36,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:36,726 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:36,726 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 07:01:36,728 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-10-05 07:01:36,728 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,728 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:36,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:36,728 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-10-05 07:01:36,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:36,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:36,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39927,1696489208029': 2023-10-05 07:01:36,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-10-05 07:01:36,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:36,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:36,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:36,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:36,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:36,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35011,1696489207914': 2023-10-05 07:01:36,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-10-05 07:01:36,735 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-10-05 07:01:36,735 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 07:01:36,735 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 07:01:36,736 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,736 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 07:01:36,737 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,737 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,737 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:36,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:36,737 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:36,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,737 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:36,737 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,737 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:36,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:36,737 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:36,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:36,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,738 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,738 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:01:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:36,738 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 07:01:36,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-10-05 07:01:36,739 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 07:01:36,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:36,740 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,740 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,741 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,743 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,743 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,743 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:36,743 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:36,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:36,743 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:36,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:36,743 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:36,743 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:36,743 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:36,743 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:36,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:36,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:36,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:36,745 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,745 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:36,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:36,743 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:36,745 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-10-05 07:01:36,745 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:36,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:36,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 07:01:36,745 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:36,746 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,746 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:36,746 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:36,746 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,746 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231005c8cf73a2a8524f51ba03c93a8f4ec0ff, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005a143dcf9e9804b27bf945b01b2d92d44] mob files 2023-10-05 07:01:36,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231005c8cf73a2a8524f51ba03c93a8f4ec0ff 2023-10-05 07:01:36,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005a143dcf9e9804b27bf945b01b2d92d44 2023-10-05 07:01:36,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,781 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-10-05 07:01:36,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,781 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1696489296637Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1696489296753 (+116 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1696489296753Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1696489296753Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1696489296756 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1696489296774 (+18 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1696489296781 (+7 ms) 2023-10-05 07:01:36,786 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-10-05 07:01:36,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 148 msec 2023-10-05 07:01:36,939 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:01:36,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-10-05 07:01:36,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 07:01:36,941 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489296941 2023-10-05 07:01:36,941 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41859, tgtDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489296941, rawTgtDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489296941, srcFsUri=hdfs://localhost:41859, srcDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:01:36,963 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41859, inputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:01:36,963 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1059699323_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489296941, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489296941/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,963 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41859, inputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0, snapshotDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-10-05 07:01:36,969 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489296941/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:36,989 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:36,990 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:36,990 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:36,990 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:37,868 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop-2733976771878760859.jar 2023-10-05 07:01:37,868 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:37,869 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:37,935 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop-1085026796457673235.jar 2023-10-05 07:01:37,935 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:37,936 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:37,936 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:37,936 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:37,937 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:37,937 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:37,937 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 07:01:37,938 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 07:01:37,938 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 07:01:37,938 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 07:01:37,939 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 07:01:37,939 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 07:01:37,940 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 07:01:37,940 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 07:01:37,940 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 07:01:37,941 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 07:01:37,941 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:01:37,942 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:01:37,942 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:01:37,942 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:01:37,943 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:01:37,943 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:01:37,944 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:01:38,300 WARN [Listener at jenkins-hbase4.apache.org/36167] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 07:01:38,302 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-10-05 07:01:39,388 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 07:01:39,388 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 07:01:39,395 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0005_000001 (auth:SIMPLE) 2023-10-05 07:01:40,002 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0006_000001 (auth:SIMPLE) 2023-10-05 07:01:40,673 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 07:01:43,857 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0006_000001 (auth:SIMPLE) 2023-10-05 07:01:46,653 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 07:01:46,654 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 07:01:46,659 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:46,659 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 07:01:46,660 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 07:01:46,660 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740582836_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:46,660 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-05 07:01:46,660 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-05 07:01:46,660 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740582836_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489296941/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489296941/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:46,661 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489296941/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-10-05 07:01:46,661 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489296941/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-10-05 07:01:46,665 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 07:01:46,670 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489306670"}]},"ts":"1696489306670"} 2023-10-05 07:01:46,671 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-10-05 07:01:46,673 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-10-05 07:01:46,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a5c50a5a7e0cced616a5d49282ac0eb, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=409d7b62c55dcb2fa5294fdc29a256bd, UNASSIGN}] 2023-10-05 07:01:46,675 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a5c50a5a7e0cced616a5d49282ac0eb, UNASSIGN 2023-10-05 07:01:46,675 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=409d7b62c55dcb2fa5294fdc29a256bd, UNASSIGN 2023-10-05 07:01:46,676 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8a5c50a5a7e0cced616a5d49282ac0eb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:46,676 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=409d7b62c55dcb2fa5294fdc29a256bd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:46,676 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696489306676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489306676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489306676"}]},"ts":"1696489306676"} 2023-10-05 07:01:46,676 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696489306676"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489306676"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489306676"}]},"ts":"1696489306676"} 2023-10-05 07:01:46,677 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 8a5c50a5a7e0cced616a5d49282ac0eb, server=jenkins-hbase4.apache.org,35011,1696489207914}] 2023-10-05 07:01:46,678 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 409d7b62c55dcb2fa5294fdc29a256bd, server=jenkins-hbase4.apache.org,39927,1696489208029}] 2023-10-05 07:01:46,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 07:01:46,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8a5c50a5a7e0cced616a5d49282ac0eb 2023-10-05 07:01:46,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 409d7b62c55dcb2fa5294fdc29a256bd 2023-10-05 07:01:46,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8a5c50a5a7e0cced616a5d49282ac0eb, disabling compactions & flushes 2023-10-05 07:01:46,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 409d7b62c55dcb2fa5294fdc29a256bd, disabling compactions & flushes 2023-10-05 07:01:46,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:46,829 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. 2023-10-05 07:01:46,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. 2023-10-05 07:01:46,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:46,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. after waiting 0 ms 2023-10-05 07:01:46,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. 2023-10-05 07:01:46,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. after waiting 0 ms 2023-10-05 07:01:46,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:46,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 07:01:46,838 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 07:01:46,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:01:46,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:01:46,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb. 2023-10-05 07:01:46,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8a5c50a5a7e0cced616a5d49282ac0eb: 2023-10-05 07:01:46,840 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd. 2023-10-05 07:01:46,840 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 409d7b62c55dcb2fa5294fdc29a256bd: 2023-10-05 07:01:46,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 409d7b62c55dcb2fa5294fdc29a256bd 2023-10-05 07:01:46,842 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=409d7b62c55dcb2fa5294fdc29a256bd, regionState=CLOSED 2023-10-05 07:01:46,842 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696489306842"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489306842"}]},"ts":"1696489306842"} 2023-10-05 07:01:46,842 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8a5c50a5a7e0cced616a5d49282ac0eb 2023-10-05 07:01:46,847 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8a5c50a5a7e0cced616a5d49282ac0eb, regionState=CLOSED 2023-10-05 07:01:46,847 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1696489306847"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489306847"}]},"ts":"1696489306847"} 2023-10-05 07:01:46,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-10-05 07:01:46,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 409d7b62c55dcb2fa5294fdc29a256bd, server=jenkins-hbase4.apache.org,39927,1696489208029 in 169 msec 2023-10-05 07:01:46,850 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-10-05 07:01:46,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=409d7b62c55dcb2fa5294fdc29a256bd, UNASSIGN in 176 msec 2023-10-05 07:01:46,850 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 8a5c50a5a7e0cced616a5d49282ac0eb, server=jenkins-hbase4.apache.org,35011,1696489207914 in 171 msec 2023-10-05 07:01:46,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-10-05 07:01:46,852 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a5c50a5a7e0cced616a5d49282ac0eb, UNASSIGN in 177 msec 2023-10-05 07:01:46,852 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489306852"}]},"ts":"1696489306852"} 2023-10-05 07:01:46,853 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-10-05 07:01:46,855 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-10-05 07:01:46,856 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 189 msec 2023-10-05 07:01:46,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-10-05 07:01:46,972 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-10-05 07:01:46,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,976 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,976 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,978 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39927] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,981 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb 2023-10-05 07:01:46,981 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd 2023-10-05 07:01:46,981 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,981 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,981 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,981 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,982 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 07:01:46,982 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 07:01:46,982 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 07:01:46,982 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-10-05 07:01:46,983 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,983 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:46,983 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,983 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:46,983 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,983 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd/cf, FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd/recovered.edits] 2023-10-05 07:01:46,983 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:46,983 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-10-05 07:01:46,983 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:46,983 DEBUG [HFileArchiver-17] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb/cf, FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb/recovered.edits] 2023-10-05 07:01:46,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-05 07:01:46,987 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd/cf/5925878d555947bd9161f516e83f5e6a to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd/cf/5925878d555947bd9161f516e83f5e6a 2023-10-05 07:01:46,987 DEBUG [HFileArchiver-17] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb/cf/81b022efaa2a4f029b3a362e852d990b to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb/cf/81b022efaa2a4f029b3a362e852d990b 2023-10-05 07:01:46,990 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd/recovered.edits/9.seqid to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd/recovered.edits/9.seqid 2023-10-05 07:01:46,990 DEBUG [HFileArchiver-17] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb/recovered.edits/9.seqid to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb/recovered.edits/9.seqid 2023-10-05 07:01:46,990 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/409d7b62c55dcb2fa5294fdc29a256bd 2023-10-05 07:01:46,990 DEBUG [HFileArchiver-17] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a5c50a5a7e0cced616a5d49282ac0eb 2023-10-05 07:01:46,990 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-10-05 07:01:46,991 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-05 07:01:46,991 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-10-05 07:01:46,995 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231005c8cf73a2a8524f51ba03c93a8f4ec0ff to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20231005c8cf73a2a8524f51ba03c93a8f4ec0ff 2023-10-05 07:01:46,996 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005a143dcf9e9804b27bf945b01b2d92d44 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20231005a143dcf9e9804b27bf945b01b2d92d44 2023-10-05 07:01:46,996 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-10-05 07:01:46,998 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 07:01:47,000 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-10-05 07:01:47,002 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-10-05 07:01:47,003 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 07:01:47,003 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-10-05 07:01:47,003 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696489307003"}]},"ts":"9223372036854775807"} 2023-10-05 07:01:47,003 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696489307003"}]},"ts":"9223372036854775807"} 2023-10-05 07:01:47,005 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 07:01:47,005 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8a5c50a5a7e0cced616a5d49282ac0eb, NAME => 'testtb-testEmptyExportFileSystemState,,1696489295818.8a5c50a5a7e0cced616a5d49282ac0eb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 409d7b62c55dcb2fa5294fdc29a256bd, NAME => 'testtb-testEmptyExportFileSystemState,1,1696489295818.409d7b62c55dcb2fa5294fdc29a256bd.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 07:01:47,005 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-10-05 07:01:47,005 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696489307005"}]},"ts":"9223372036854775807"} 2023-10-05 07:01:47,007 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-10-05 07:01:47,009 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-10-05 07:01:47,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 36 msec 2023-10-05 07:01:47,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-05 07:01:47,086 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-10-05 07:01:47,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-10-05 07:01:47,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:47,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-10-05 07:01:47,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-10-05 07:01:47,126 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 757) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:41971 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740582836_17 at /127.0.0.1:41370 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740582836_17 at /127.0.0.1:45788 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:42589 from appattempt_1696489214609_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (698022672) connection to jenkins-hbase4.apache.org/172.31.14.131:39687 from appattempt_1696489214609_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4614 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1523993324_1 at /127.0.0.1:40658 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x54d69dd8-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1740582836_17 at /127.0.0.1:41818 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 918) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=157 (was 185), ProcessCount=168 (was 168), AvailableMemoryMB=5761 (was 5791) 2023-10-05 07:01:47,126 WARN [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 07:01:47,149 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=157, ProcessCount=168, AvailableMemoryMB=5760 2023-10-05 07:01:47,150 WARN [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 07:01:47,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-05 07:01:47,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,155 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-10-05 07:01:47,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-10-05 07:01:47,155 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-05 07:01:47,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 07:01:47,158 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391 2023-10-05 07:01:47,158 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def 2023-10-05 07:01:47,158 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391 empty. 2023-10-05 07:01:47,158 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def empty. 2023-10-05 07:01:47,158 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391 2023-10-05 07:01:47,159 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def 2023-10-05 07:01:47,159 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-05 07:01:47,168 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-10-05 07:01:47,169 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => ae07974707ff73cd7ed1643d1dad3391, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp 2023-10-05 07:01:47,169 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => a63e8173d12ee8fee168e198a4f25def, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp 2023-10-05 07:01:47,185 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:47,185 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing a63e8173d12ee8fee168e198a4f25def, disabling compactions & flushes 2023-10-05 07:01:47,185 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. 2023-10-05 07:01:47,185 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. 2023-10-05 07:01:47,185 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. after waiting 0 ms 2023-10-05 07:01:47,185 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. 2023-10-05 07:01:47,186 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:47,186 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. 2023-10-05 07:01:47,186 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing ae07974707ff73cd7ed1643d1dad3391, disabling compactions & flushes 2023-10-05 07:01:47,186 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for a63e8173d12ee8fee168e198a4f25def: 2023-10-05 07:01:47,186 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:01:47,186 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:01:47,186 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. after waiting 0 ms 2023-10-05 07:01:47,186 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:01:47,186 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:01:47,186 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for ae07974707ff73cd7ed1643d1dad3391: 2023-10-05 07:01:47,188 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-10-05 07:01:47,189 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696489307189"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489307189"}]},"ts":"1696489307189"} 2023-10-05 07:01:47,189 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696489307189"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489307189"}]},"ts":"1696489307189"} 2023-10-05 07:01:47,191 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-10-05 07:01:47,191 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-05 07:01:47,192 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489307192"}]},"ts":"1696489307192"} 2023-10-05 07:01:47,193 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-10-05 07:01:47,197 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-10-05 07:01:47,198 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-10-05 07:01:47,198 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-10-05 07:01:47,198 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-10-05 07:01:47,198 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-10-05 07:01:47,198 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ae07974707ff73cd7ed1643d1dad3391, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a63e8173d12ee8fee168e198a4f25def, ASSIGN}] 2023-10-05 07:01:47,200 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a63e8173d12ee8fee168e198a4f25def, ASSIGN 2023-10-05 07:01:47,200 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ae07974707ff73cd7ed1643d1dad3391, ASSIGN 2023-10-05 07:01:47,201 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a63e8173d12ee8fee168e198a4f25def, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39927,1696489208029; forceNewPlan=false, retain=false 2023-10-05 07:01:47,201 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ae07974707ff73cd7ed1643d1dad3391, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33577,1696489207986; forceNewPlan=false, retain=false 2023-10-05 07:01:47,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 07:01:47,351 INFO [jenkins-hbase4:33507] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-10-05 07:01:47,354 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a63e8173d12ee8fee168e198a4f25def, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,354 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ae07974707ff73cd7ed1643d1dad3391, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,354 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696489307354"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489307354"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489307354"}]},"ts":"1696489307354"} 2023-10-05 07:01:47,354 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696489307354"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489307354"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489307354"}]},"ts":"1696489307354"} 2023-10-05 07:01:47,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure a63e8173d12ee8fee168e198a4f25def, server=jenkins-hbase4.apache.org,39927,1696489208029}] 2023-10-05 07:01:47,356 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure ae07974707ff73cd7ed1643d1dad3391, server=jenkins-hbase4.apache.org,33577,1696489207986}] 2023-10-05 07:01:47,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 07:01:47,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. 2023-10-05 07:01:47,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a63e8173d12ee8fee168e198a4f25def, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def.', STARTKEY => '1', ENDKEY => ''} 2023-10-05 07:01:47,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:01:47,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ae07974707ff73cd7ed1643d1dad3391, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391.', STARTKEY => '', ENDKEY => '1'} 2023-10-05 07:01:47,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. service=AccessControlService 2023-10-05 07:01:47,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. service=AccessControlService 2023-10-05 07:01:47,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:01:47,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-10-05 07:01:47,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp ae07974707ff73cd7ed1643d1dad3391 2023-10-05 07:01:47,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a63e8173d12ee8fee168e198a4f25def 2023-10-05 07:01:47,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:47,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-05 07:01:47,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ae07974707ff73cd7ed1643d1dad3391 2023-10-05 07:01:47,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a63e8173d12ee8fee168e198a4f25def 2023-10-05 07:01:47,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ae07974707ff73cd7ed1643d1dad3391 2023-10-05 07:01:47,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a63e8173d12ee8fee168e198a4f25def 2023-10-05 07:01:47,513 INFO [StoreOpener-ae07974707ff73cd7ed1643d1dad3391-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ae07974707ff73cd7ed1643d1dad3391 2023-10-05 07:01:47,513 INFO [StoreOpener-a63e8173d12ee8fee168e198a4f25def-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a63e8173d12ee8fee168e198a4f25def 2023-10-05 07:01:47,514 DEBUG [StoreOpener-ae07974707ff73cd7ed1643d1dad3391-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391/cf 2023-10-05 07:01:47,514 DEBUG [StoreOpener-a63e8173d12ee8fee168e198a4f25def-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def/cf 2023-10-05 07:01:47,514 DEBUG [StoreOpener-a63e8173d12ee8fee168e198a4f25def-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def/cf 2023-10-05 07:01:47,514 DEBUG [StoreOpener-ae07974707ff73cd7ed1643d1dad3391-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391/cf 2023-10-05 07:01:47,515 INFO [StoreOpener-ae07974707ff73cd7ed1643d1dad3391-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae07974707ff73cd7ed1643d1dad3391 columnFamilyName cf 2023-10-05 07:01:47,515 INFO [StoreOpener-a63e8173d12ee8fee168e198a4f25def-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a63e8173d12ee8fee168e198a4f25def columnFamilyName cf 2023-10-05 07:01:47,516 INFO [StoreOpener-ae07974707ff73cd7ed1643d1dad3391-1] regionserver.HStore(310): Store=ae07974707ff73cd7ed1643d1dad3391/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:01:47,516 INFO [StoreOpener-a63e8173d12ee8fee168e198a4f25def-1] regionserver.HStore(310): Store=a63e8173d12ee8fee168e198a4f25def/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-05 07:01:47,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391 2023-10-05 07:01:47,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def 2023-10-05 07:01:47,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391 2023-10-05 07:01:47,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def 2023-10-05 07:01:47,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a63e8173d12ee8fee168e198a4f25def 2023-10-05 07:01:47,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ae07974707ff73cd7ed1643d1dad3391 2023-10-05 07:01:47,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:01:47,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-05 07:01:47,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ae07974707ff73cd7ed1643d1dad3391; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68230836, jitterRate=0.016718685626983643}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:01:47,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a63e8173d12ee8fee168e198a4f25def; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60547514, jitterRate=-0.09777173399925232}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-05 07:01:47,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ae07974707ff73cd7ed1643d1dad3391: 2023-10-05 07:01:47,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a63e8173d12ee8fee168e198a4f25def: 2023-10-05 07:01:47,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def., pid=108, masterSystemTime=1696489307507 2023-10-05 07:01:47,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391., pid=109, masterSystemTime=1696489307509 2023-10-05 07:01:47,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:01:47,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:01:47,524 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ae07974707ff73cd7ed1643d1dad3391, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. 2023-10-05 07:01:47,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. 2023-10-05 07:01:47,525 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696489307524"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489307524"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489307524"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489307524"}]},"ts":"1696489307524"} 2023-10-05 07:01:47,525 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a63e8173d12ee8fee168e198a4f25def, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,525 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696489307525"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1696489307525"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1696489307525"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1696489307525"}]},"ts":"1696489307525"} 2023-10-05 07:01:47,527 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-10-05 07:01:47,527 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure ae07974707ff73cd7ed1643d1dad3391, server=jenkins-hbase4.apache.org,33577,1696489207986 in 170 msec 2023-10-05 07:01:47,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-10-05 07:01:47,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure a63e8173d12ee8fee168e198a4f25def, server=jenkins-hbase4.apache.org,39927,1696489208029 in 171 msec 2023-10-05 07:01:47,528 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ae07974707ff73cd7ed1643d1dad3391, ASSIGN in 329 msec 2023-10-05 07:01:47,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-10-05 07:01:47,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a63e8173d12ee8fee168e198a4f25def, ASSIGN in 330 msec 2023-10-05 07:01:47,530 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-05 07:01:47,530 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489307530"}]},"ts":"1696489307530"} 2023-10-05 07:01:47,531 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-10-05 07:01:47,533 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-10-05 07:01:47,533 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-10-05 07:01:47,534 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39927] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 07:01:47,536 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:47,536 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:47,536 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:47,536 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:01:47,537 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:47,537 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:47,537 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:47,538 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-10-05 07:01:47,538 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 385 msec 2023-10-05 07:01:47,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-05 07:01:47,759 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-10-05 07:01:47,761 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,761 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:01:47,763 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 07:01:47,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 07:01:47,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696489307773 (current time:1696489307773). 2023-10-05 07:01:47,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 07:01:47,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x3da449cc to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:01:47,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53f6685d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:01:47,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:47,784 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:47,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3da449cc to 127.0.0.1:58805 2023-10-05 07:01:47,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:01:47,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x55f6c21d to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:01:47,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a031b46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:01:47,792 DEBUG [hconnection-0x2a5736db-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:47,794 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:47,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:47,799 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:47,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55f6c21d to 127.0.0.1:58805 2023-10-05 07:01:47,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:01:47,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 07:01:47,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 07:01:47,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 07:01:47,803 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot, current working dir path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 07:01:47,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 07:01:47,805 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 07:01:47,806 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696489907806 2023-10-05 07:01:47,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(689): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 07:01:47,806 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,807 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 07:01:47,807 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 07:01:47,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 07:01:47,808 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 07:01:47,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-05 07:01:47,810 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 07:01:47,810 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696489907810 2023-10-05 07:01:47,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,823 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-05 07:01:47,823 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:47,824 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-05 07:01:47,824 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-05 07:01:47,824 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,824 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,827 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:47,827 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:47,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:47,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:47,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:47,827 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,827 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:47,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:47,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:47,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:47,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,827 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,827 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,828 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,828 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 07:01:47,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 07:01:47,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 07:01:47,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,828 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 07:01:47,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-10-05 07:01:47,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,828 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 07:01:47,828 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 07:01:47,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,829 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,829 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 07:01:47,829 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 07:01:47,829 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:47,829 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:47,829 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,831 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 07:01:47,831 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 07:01:47,831 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:47,830 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 07:01:47,832 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 07:01:47,832 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 07:01:47,832 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 07:01:47,832 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 07:01:47,831 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 07:01:47,832 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 07:01:47,832 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 07:01:47,837 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,837 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:47,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:47,838 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:47,838 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,838 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:47,838 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,838 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:47,838 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,838 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:47,838 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,838 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:47,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:47,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:47,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 07:01:47,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c197717[Count = 1] remaining members to acquire global barrier 2023-10-05 07:01:47,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:47,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:47,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:47,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:47,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:47,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:47,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 07:01:47,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c197717[Count = 0] remaining members to acquire global barrier 2023-10-05 07:01:47,841 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-05 07:01:47,842 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,843 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,843 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,843 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,843 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 07:01:47,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,843 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,843 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 07:01:47,843 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 07:01:47,843 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 07:01:47,843 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35011,1696489207914' in zk 2023-10-05 07:01:47,843 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,843 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 07:01:47,843 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:01:47,843 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:01:47,843 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:01:47,844 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:01:47,843 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:01:47,843 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. 2023-10-05 07:01:47,844 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. started... 2023-10-05 07:01:47,844 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. started... 2023-10-05 07:01:47,844 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ae07974707ff73cd7ed1643d1dad3391: 2023-10-05 07:01:47,845 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a63e8173d12ee8fee168e198a4f25def: 2023-10-05 07:01:47,845 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 07:01:47,845 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:47,845 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,845 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 07:01:47,845 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,846 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:01:47,846 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:01:47,846 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 07:01:47,846 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-10-05 07:01:47,864 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. completed. 2023-10-05 07:01:47,864 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:01:47,864 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:01:47,864 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:01:47,864 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,864 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 07:01:47,864 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33577,1696489207986' in zk 2023-10-05 07:01:47,866 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. completed. 2023-10-05 07:01:47,866 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. 2023-10-05 07:01:47,866 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:01:47,866 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:01:47,866 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,866 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 07:01:47,866 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39927,1696489208029' in zk 2023-10-05 07:01:47,867 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,867 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 07:01:47,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:47,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:47,867 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:47,867 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 07:01:47,869 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 07:01:47,869 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,869 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:47,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:47,869 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 07:01:47,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:47,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:47,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:47,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:47,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33577,1696489207986': 2023-10-05 07:01:47,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-05 07:01:47,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:47,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:47,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39927,1696489208029': 2023-10-05 07:01:47,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-05 07:01:47,876 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-05 07:01:47,877 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 07:01:47,877 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 07:01:47,877 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,877 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 07:01:47,878 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,878 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,878 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,878 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,878 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:47,878 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:47,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,878 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:47,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:47,879 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:47,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:47,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,879 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,880 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:47,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:47,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,881 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:47,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:47,882 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,882 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,884 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,884 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,884 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:47,884 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:47,884 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:47,885 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:47,884 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:47,885 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:47,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:47,885 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:47,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:47,885 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:47,885 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:47,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:47,886 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:47,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:47,885 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:47,886 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,886 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:47,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:47,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:47,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:47,886 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:47,887 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:47,887 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:47,887 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:47,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 07:01:47,888 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-10-05 07:01:47,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,907 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:01:47,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 07:01:47,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(406): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-05 07:01:47,908 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 07:01:47,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,915 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-05 07:01:47,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,916 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:47,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696489307806Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696489307895 (+89 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696489307895Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696489307895Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696489307901 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1696489307909 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696489307915 (+6 ms) 2023-10-05 07:01:47,919 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 07:01:47,920 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 112 msec 2023-10-05 07:01:48,109 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:01:48,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 07:01:48,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(403): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 07:01:48,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33577] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 07:01:48,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39927] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. with WAL disabled. Data may be lost in the event of a crash. 2023-10-05 07:01:48,115 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,115 DEBUG [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:01:48,116 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-05 07:01:48,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 07:01:48,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1696489308124 (current time:1696489308124). 2023-10-05 07:01:48,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-05 07:01:48,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x53ec110b to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:01:48,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5eda104c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:01:48,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:48,135 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:48,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53ec110b to 127.0.0.1:58805 2023-10-05 07:01:48,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:01:48,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(139): Connect 0x5dd21c66 to 127.0.0.1:58805 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-05 07:01:48,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e052a9e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-05 07:01:48,143 DEBUG [hconnection-0x60530f62-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:48,150 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:48,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-05 07:01:48,154 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44070, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-05 07:01:48,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5dd21c66 to 127.0.0.1:58805 2023-10-05 07:01:48,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:01:48,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-10-05 07:01:48,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-05 07:01:48,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 07:01:48,159 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot, current working dir path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy32.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy35.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy36.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-05 07:01:48,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 07:01:48,161 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 07:01:48,162 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1696489908162 2023-10-05 07:01:48,162 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-10-05 07:01:48,163 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-10-05 07:01:48,163 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-05 07:01:48,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 07:01:48,164 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-10-05 07:01:48,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-10-05 07:01:48,166 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 07:01:48,167 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1696489908167 2023-10-05 07:01:48,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,181 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-10-05 07:01:48,181 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:48,182 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-10-05 07:01:48,182 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-10-05 07:01:48,183 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,183 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,185 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:48,185 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:48,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:48,185 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:48,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:48,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:48,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:48,185 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:48,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:48,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,186 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,186 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,186 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,186 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,187 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-05 07:01:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 07:01:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 07:01:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,187 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 07:01:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-10-05 07:01:48,187 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 07:01:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,187 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,187 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,187 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 07:01:48,187 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:48,187 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-10-05 07:01:48,189 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 07:01:48,189 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 07:01:48,187 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 07:01:48,189 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,189 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35011,1696489207914' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 07:01:48,189 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-10-05 07:01:48,189 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:48,189 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-05 07:01:48,191 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 07:01:48,191 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 07:01:48,191 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 07:01:48,192 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-10-05 07:01:48,192 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-10-05 07:01:48,192 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-10-05 07:01:48,194 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,194 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,194 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:48,195 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,195 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,195 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:48,195 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:48,195 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,195 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:48,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:48,195 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,195 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-05 07:01:48,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:48,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:48,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33577,1696489207986' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 07:01:48,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ac75bde[Count = 1] remaining members to acquire global barrier 2023-10-05 07:01:48,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:48,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:48,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:48,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:48,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:48,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:48,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39927,1696489208029' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-10-05 07:01:48,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ac75bde[Count = 0] remaining members to acquire global barrier 2023-10-05 07:01:48,199 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-10-05 07:01:48,199 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,204 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,204 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,204 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,204 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 07:01:48,204 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,204 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 07:01:48,204 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:01:48,205 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:01:48,205 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 07:01:48,205 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35011,1696489207914' in zk 2023-10-05 07:01:48,205 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,204 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-10-05 07:01:48,205 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-05 07:01:48,205 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. 2023-10-05 07:01:48,205 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. started... 2023-10-05 07:01:48,205 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-10-05 07:01:48,205 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-05 07:01:48,205 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a63e8173d12ee8fee168e198a4f25def 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-10-05 07:01:48,205 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:01:48,205 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. started... 2023-10-05 07:01:48,206 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ae07974707ff73cd7ed1643d1dad3391 1/1 column families, dataSize=266 B heapSize=832 B 2023-10-05 07:01:48,206 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 07:01:48,206 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:48,206 DEBUG [member: 'jenkins-hbase4.apache.org,35011,1696489207914' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 07:01:48,233 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310058ca123b8cda941c0bbb711d56e8b530d to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202310058ca123b8cda941c0bbb711d56e8b530d 2023-10-05 07:01:48,233 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023100510ef96136962455fafa07b40ecd24fbc to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100510ef96136962455fafa07b40ecd24fbc 2023-10-05 07:01:48,242 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def/.tmp/cf/7ced947c367448d4937ea1fe0b52f8d1 2023-10-05 07:01:48,243 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391/.tmp/cf/680a899e6c20404786be34e2543050d7 2023-10-05 07:01:48,247 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def/.tmp/cf/7ced947c367448d4937ea1fe0b52f8d1 as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def/cf/7ced947c367448d4937ea1fe0b52f8d1 2023-10-05 07:01:48,248 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391/.tmp/cf/680a899e6c20404786be34e2543050d7 as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391/cf/680a899e6c20404786be34e2543050d7 2023-10-05 07:01:48,252 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def/cf/7ced947c367448d4937ea1fe0b52f8d1, entries=46, sequenceid=6, filesize=13.2 K 2023-10-05 07:01:48,253 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391/cf/680a899e6c20404786be34e2543050d7, entries=4, sequenceid=6, filesize=5.6 K 2023-10-05 07:01:48,253 INFO [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for a63e8173d12ee8fee168e198a4f25def in 48ms, sequenceid=6, compaction requested=false 2023-10-05 07:01:48,253 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-10-05 07:01:48,253 INFO [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for ae07974707ff73cd7ed1643d1dad3391 in 47ms, sequenceid=6, compaction requested=false 2023-10-05 07:01:48,255 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a63e8173d12ee8fee168e198a4f25def: 2023-10-05 07:01:48,255 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ae07974707ff73cd7ed1643d1dad3391: 2023-10-05 07:01:48,255 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,255 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,255 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:01:48,255 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-05 07:01:48,255 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def/cf/7ced947c367448d4937ea1fe0b52f8d1] hfiles 2023-10-05 07:01:48,255 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391/cf/680a899e6c20404786be34e2543050d7] hfiles 2023-10-05 07:01:48,255 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def/cf/7ced947c367448d4937ea1fe0b52f8d1 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,255 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391/cf/680a899e6c20404786be34e2543050d7 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,262 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. completed. 2023-10-05 07:01:48,262 DEBUG [rs(jenkins-hbase4.apache.org,33577,1696489207986)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:01:48,262 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:01:48,262 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:01:48,262 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. completed. 2023-10-05 07:01:48,263 DEBUG [rs(jenkins-hbase4.apache.org,39927,1696489208029)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. 2023-10-05 07:01:48,263 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,263 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-10-05 07:01:48,263 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-10-05 07:01:48,263 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,263 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 07:01:48,263 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-10-05 07:01:48,263 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39927,1696489208029' in zk 2023-10-05 07:01:48,263 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33577,1696489207986' in zk 2023-10-05 07:01:48,264 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:01:48,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 07:01:48,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-10-05 07:01:48,265 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-05 07:01:48,265 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,265 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 07:01:48,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:48,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:48,265 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:48,265 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,265 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-10-05 07:01:48,265 DEBUG [member: 'jenkins-hbase4.apache.org,33577,1696489207986' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 07:01:48,267 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:48,267 DEBUG [member: 'jenkins-hbase4.apache.org,39927,1696489208029' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-10-05 07:01:48,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:48,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:48,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:48,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:48,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:48,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33577,1696489207986': 2023-10-05 07:01:48,271 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33577,1696489207986' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-10-05 07:01:48,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:48,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:48,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:48,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:48,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:48,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:48,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:48,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39927,1696489208029': 2023-10-05 07:01:48,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39927,1696489208029' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-10-05 07:01:48,274 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-10-05 07:01:48,274 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-05 07:01:48,274 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-05 07:01:48,274 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,274 INFO [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-05 07:01:48,275 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,275 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,275 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:48,275 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:48,275 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,275 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,275 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:48,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-05 07:01:48,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-05 07:01:48,276 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:48,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:48,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:48,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:48,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:48,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:48,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-05 07:01:48,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:48,276 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,277 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-05 07:01:48,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:48,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,278 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:48,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-05 07:01:48,278 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,279 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:48,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,282 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,282 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,282 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,282 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:48,282 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:48,282 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,282 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:48,282 DEBUG [(jenkins-hbase4.apache.org,33507,1696489206530)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-05 07:01:48,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:48,282 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:01:48,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:48,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:48,282 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:48,282 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-05 07:01:48,284 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-05 07:01:48,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:48,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-05 07:01:48,282 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:48,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:48,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:48,282 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,284 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:48,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,284 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:01:48,284 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-05 07:01:48,284 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-05 07:01:48,284 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:01:48,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:48,284 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-05 07:01:48,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-05 07:01:48,285 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100510ef96136962455fafa07b40ecd24fbc, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202310058ca123b8cda941c0bbb711d56e8b530d] mob files 2023-10-05 07:01:48,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100510ef96136962455fafa07b40ecd24fbc 2023-10-05 07:01:48,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202310058ca123b8cda941c0bbb711d56e8b530d 2023-10-05 07:01:48,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,292 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,307 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-10-05 07:01:48,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,308 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1696489308162Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1696489308291 (+129 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696489308291Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1696489308291Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1696489308295 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1696489308301 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1696489308307 (+6 ms) 2023-10-05 07:01:48,311 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-10-05 07:01:48,312 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 148 msec 2023-10-05 07:01:48,465 DEBUG [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-05 07:01:48,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-10-05 07:01:48,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-05 07:01:48,466 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489308466 2023-10-05 07:01:48,466 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41859, tgtDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489308466, rawTgtDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489308466, srcFsUri=hdfs://localhost:41859, srcDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:01:48,487 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41859, inputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0 2023-10-05 07:01:48,487 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_308098800_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489308466, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489308466/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,487 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41859, inputRoot=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0, snapshotDir=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-10-05 07:01:48,498 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489308466/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:01:48,512 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:48,512 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:48,512 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:48,513 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:49,391 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop-3585564772767718298.jar 2023-10-05 07:01:49,391 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:49,391 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:49,459 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/hadoop-1544792860243839534.jar 2023-10-05 07:01:49,460 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:49,460 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:49,461 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:49,461 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:49,462 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:49,462 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-10-05 07:01:49,463 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-10-05 07:01:49,463 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-10-05 07:01:49,464 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-10-05 07:01:49,464 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-10-05 07:01:49,465 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-10-05 07:01:49,465 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-10-05 07:01:49,465 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-10-05 07:01:49,466 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-10-05 07:01:49,466 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-10-05 07:01:49,466 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-10-05 07:01:49,467 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:01:49,467 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:01:49,468 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:01:49,468 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:01:49,468 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-10-05 07:01:49,469 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:01:49,469 DEBUG [Listener at jenkins-hbase4.apache.org/36167] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-10-05 07:01:49,826 WARN [Listener at jenkins-hbase4.apache.org/36167] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-10-05 07:01:49,828 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-10-05 07:01:49,830 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-10-05 07:01:51,182 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 07:01:51,182 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-10-05 07:01:51,184 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0006_000001 (auth:SIMPLE) 2023-10-05 07:01:51,402 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0007_000001 (auth:SIMPLE) 2023-10-05 07:01:52,421 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 07:01:55,167 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0007_000001 (auth:SIMPLE) 2023-10-05 07:01:57,375 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0007_000001 (auth:SIMPLE) 2023-10-05 07:01:59,898 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1696489214609_0007_000001 (auth:SIMPLE) 2023-10-05 07:02:00,985 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-10-05 07:02:00,985 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-10-05 07:02:00,996 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:00,996 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(279): Exported snapshot 2023-10-05 07:02:00,996 INFO [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-10-05 07:02:00,997 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740582836_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:00,997 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-05 07:02:00,997 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-05 07:02:00,997 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1740582836_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489308466/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489308466/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:00,998 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489308466/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-10-05 07:02:00,998 DEBUG [Listener at jenkins-hbase4.apache.org/36167] snapshot.TestExportSnapshot(367): hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/export-test/export-1696489308466/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-10-05 07:02:01,003 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 07:02:01,007 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489321007"}]},"ts":"1696489321007"} 2023-10-05 07:02:01,008 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-10-05 07:02:01,009 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-10-05 07:02:01,010 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ae07974707ff73cd7ed1643d1dad3391, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a63e8173d12ee8fee168e198a4f25def, UNASSIGN}] 2023-10-05 07:02:01,012 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ae07974707ff73cd7ed1643d1dad3391, UNASSIGN 2023-10-05 07:02:01,012 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a63e8173d12ee8fee168e198a4f25def, UNASSIGN 2023-10-05 07:02:01,012 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ae07974707ff73cd7ed1643d1dad3391, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:02:01,012 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a63e8173d12ee8fee168e198a4f25def, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:02:01,012 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696489321012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489321012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489321012"}]},"ts":"1696489321012"} 2023-10-05 07:02:01,012 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696489321012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1696489321012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1696489321012"}]},"ts":"1696489321012"} 2023-10-05 07:02:01,014 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure ae07974707ff73cd7ed1643d1dad3391, server=jenkins-hbase4.apache.org,33577,1696489207986}] 2023-10-05 07:02:01,014 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure a63e8173d12ee8fee168e198a4f25def, server=jenkins-hbase4.apache.org,39927,1696489208029}] 2023-10-05 07:02:01,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 07:02:01,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ae07974707ff73cd7ed1643d1dad3391 2023-10-05 07:02:01,165 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a63e8173d12ee8fee168e198a4f25def 2023-10-05 07:02:01,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ae07974707ff73cd7ed1643d1dad3391, disabling compactions & flushes 2023-10-05 07:02:01,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a63e8173d12ee8fee168e198a4f25def, disabling compactions & flushes 2023-10-05 07:02:01,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:02:01,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. 2023-10-05 07:02:01,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. 2023-10-05 07:02:01,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:02:01,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. after waiting 0 ms 2023-10-05 07:02:01,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. after waiting 0 ms 2023-10-05 07:02:01,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:02:01,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. 2023-10-05 07:02:01,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 07:02:01,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 07:02:01,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:02:01,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:02:01,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391. 2023-10-05 07:02:01,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def. 2023-10-05 07:02:01,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ae07974707ff73cd7ed1643d1dad3391: 2023-10-05 07:02:01,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a63e8173d12ee8fee168e198a4f25def: 2023-10-05 07:02:01,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ae07974707ff73cd7ed1643d1dad3391 2023-10-05 07:02:01,182 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ae07974707ff73cd7ed1643d1dad3391, regionState=CLOSED 2023-10-05 07:02:01,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a63e8173d12ee8fee168e198a4f25def 2023-10-05 07:02:01,182 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696489321182"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489321182"}]},"ts":"1696489321182"} 2023-10-05 07:02:01,183 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a63e8173d12ee8fee168e198a4f25def, regionState=CLOSED 2023-10-05 07:02:01,183 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1696489321182"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1696489321182"}]},"ts":"1696489321182"} 2023-10-05 07:02:01,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-10-05 07:02:01,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure ae07974707ff73cd7ed1643d1dad3391, server=jenkins-hbase4.apache.org,33577,1696489207986 in 169 msec 2023-10-05 07:02:01,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-05 07:02:01,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure a63e8173d12ee8fee168e198a4f25def, server=jenkins-hbase4.apache.org,39927,1696489208029 in 170 msec 2023-10-05 07:02:01,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ae07974707ff73cd7ed1643d1dad3391, UNASSIGN in 175 msec 2023-10-05 07:02:01,188 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-10-05 07:02:01,188 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a63e8173d12ee8fee168e198a4f25def, UNASSIGN in 176 msec 2023-10-05 07:02:01,188 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1696489321188"}]},"ts":"1696489321188"} 2023-10-05 07:02:01,190 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-10-05 07:02:01,191 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-10-05 07:02:01,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 188 msec 2023-10-05 07:02:01,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-10-05 07:02:01,309 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-10-05 07:02:01,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,313 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,313 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,315 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39927] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,317 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391 2023-10-05 07:02:01,317 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def 2023-10-05 07:02:01,319 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391/cf, FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391/recovered.edits] 2023-10-05 07:02:01,319 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def/cf, FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def/recovered.edits] 2023-10-05 07:02:01,321 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,321 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,321 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,321 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 07:02:01,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 07:02:01,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 07:02:01,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-10-05 07:02:01,323 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,323 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,323 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,323 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:02:01,323 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:02:01,323 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,323 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:02:01,323 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-10-05 07:02:01,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-05 07:02:01,325 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391/cf/680a899e6c20404786be34e2543050d7 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391/cf/680a899e6c20404786be34e2543050d7 2023-10-05 07:02:01,325 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def/cf/7ced947c367448d4937ea1fe0b52f8d1 to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def/cf/7ced947c367448d4937ea1fe0b52f8d1 2023-10-05 07:02:01,328 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391/recovered.edits/9.seqid to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391/recovered.edits/9.seqid 2023-10-05 07:02:01,328 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def/recovered.edits/9.seqid to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def/recovered.edits/9.seqid 2023-10-05 07:02:01,329 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ae07974707ff73cd7ed1643d1dad3391 2023-10-05 07:02:01,329 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a63e8173d12ee8fee168e198a4f25def 2023-10-05 07:02:01,329 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-10-05 07:02:01,329 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-05 07:02:01,330 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-10-05 07:02:01,333 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100510ef96136962455fafa07b40ecd24fbc to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023100510ef96136962455fafa07b40ecd24fbc 2023-10-05 07:02:01,335 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202310058ca123b8cda941c0bbb711d56e8b530d to hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202310058ca123b8cda941c0bbb711d56e8b530d 2023-10-05 07:02:01,335 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-10-05 07:02:01,337 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,339 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-10-05 07:02:01,341 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-10-05 07:02:01,342 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,342 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-10-05 07:02:01,342 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696489321342"}]},"ts":"9223372036854775807"} 2023-10-05 07:02:01,342 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1696489321342"}]},"ts":"9223372036854775807"} 2023-10-05 07:02:01,343 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-10-05 07:02:01,343 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ae07974707ff73cd7ed1643d1dad3391, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1696489307151.ae07974707ff73cd7ed1643d1dad3391.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a63e8173d12ee8fee168e198a4f25def, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1696489307151.a63e8173d12ee8fee168e198a4f25def.', STARTKEY => '1', ENDKEY => ''}] 2023-10-05 07:02:01,343 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-10-05 07:02:01,344 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1696489321343"}]},"ts":"9223372036854775807"} 2023-10-05 07:02:01,345 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-10-05 07:02:01,347 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,347 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 37 msec 2023-10-05 07:02:01,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-10-05 07:02:01,425 INFO [Listener at jenkins-hbase4.apache.org/36167] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-10-05 07:02:01,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-05 07:02:01,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(335): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-10-05 07:02:01,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33507] snapshot.SnapshotManager(335): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-10-05 07:02:01,462 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 765), OpenFileDescriptor=915 (was 931), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=181 (was 157) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=5685 (was 5760) 2023-10-05 07:02:01,463 WARN [Listener at jenkins-hbase4.apache.org/36167] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-10-05 07:02:01,463 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-10-05 07:02:01,473 INFO [Listener at jenkins-hbase4.apache.org/36167] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 07:02:01,584 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1696489214609_0007_01_000001 is : 143 2023-10-05 07:02:06,747 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-10-05 07:02:15,597 INFO [Listener at jenkins-hbase4.apache.org/36167] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 07:02:29,713 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 07:02:29,713 INFO [Listener at jenkins-hbase4.apache.org/36167] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 07:02:29,824 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-10-05 07:02:29,832 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-10-05 07:02:29,833 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 07:02:29,841 INFO [Listener at jenkins-hbase4.apache.org/36167] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-10-05 07:02:29,944 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-10-05 07:02:29,945 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-10-05 07:02:29,945 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-05 07:02:29,945 INFO [Listener at jenkins-hbase4.apache.org/36167] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-05 07:02:29,945 DEBUG [Listener at jenkins-hbase4.apache.org/36167] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bf08614 to 127.0.0.1:58805 2023-10-05 07:02:29,945 DEBUG [Listener at jenkins-hbase4.apache.org/36167] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:02:29,945 DEBUG [Listener at jenkins-hbase4.apache.org/36167] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-05 07:02:29,946 DEBUG [Listener at jenkins-hbase4.apache.org/36167] util.JVMClusterUtil(257): Found active master hash=1484265873, stopped=false 2023-10-05 07:02:29,946 DEBUG [Listener at jenkins-hbase4.apache.org/36167] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:02:29,946 DEBUG [Listener at jenkins-hbase4.apache.org/36167] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-10-05 07:02:29,946 INFO [Listener at jenkins-hbase4.apache.org/36167] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33507,1696489206530 2023-10-05 07:02:29,947 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 07:02:29,947 INFO [Listener at jenkins-hbase4.apache.org/36167] procedure2.ProcedureExecutor(628): Stopping 2023-10-05 07:02:29,947 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 07:02:29,947 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 07:02:29,948 DEBUG [Listener at jenkins-hbase4.apache.org/36167] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ab960fd to 127.0.0.1:58805 2023-10-05 07:02:29,947 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 07:02:29,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 07:02:29,947 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-05 07:02:29,948 DEBUG [Listener at jenkins-hbase4.apache.org/36167] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:02:29,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 07:02:29,948 INFO [Listener at jenkins-hbase4.apache.org/36167] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35011,1696489207914' ***** 2023-10-05 07:02:29,948 DEBUG [Listener at jenkins-hbase4.apache.org/36167] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:02:29,948 INFO [Listener at jenkins-hbase4.apache.org/36167] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 07:02:29,948 INFO [Listener at jenkins-hbase4.apache.org/36167] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33577,1696489207986' ***** 2023-10-05 07:02:29,949 DEBUG [Listener at jenkins-hbase4.apache.org/36167] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:02:29,949 INFO [Listener at jenkins-hbase4.apache.org/36167] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 07:02:29,949 INFO [Listener at jenkins-hbase4.apache.org/36167] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39927,1696489208029' ***** 2023-10-05 07:02:29,949 DEBUG [Listener at jenkins-hbase4.apache.org/36167] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:02:29,949 INFO [Listener at jenkins-hbase4.apache.org/36167] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-05 07:02:29,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 07:02:29,949 INFO [RS:1;jenkins-hbase4:33577] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 07:02:29,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-05 07:02:29,949 INFO [RS:2;jenkins-hbase4:39927] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 07:02:29,949 INFO [RS:0;jenkins-hbase4:35011] regionserver.HeapMemoryManager(220): Stopping 2023-10-05 07:02:29,949 INFO [RS:2;jenkins-hbase4:39927] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 07:02:29,949 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 07:02:29,949 INFO [RS:2;jenkins-hbase4:39927] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 07:02:29,949 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 07:02:29,949 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-05 07:02:29,949 INFO [RS:0;jenkins-hbase4:35011] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 07:02:29,950 INFO [RS:0;jenkins-hbase4:35011] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 07:02:29,950 INFO [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(3305): Received CLOSE for db466438afcbe211bce2591ee5f088a3 2023-10-05 07:02:29,949 INFO [RS:1;jenkins-hbase4:33577] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-05 07:02:29,950 INFO [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:02:29,950 INFO [RS:1;jenkins-hbase4:33577] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-05 07:02:29,950 DEBUG [RS:0;jenkins-hbase4:35011] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7810b055 to 127.0.0.1:58805 2023-10-05 07:02:29,950 INFO [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(3305): Received CLOSE for 10f773d120b025203d205e5501cc214d 2023-10-05 07:02:29,950 DEBUG [RS:0;jenkins-hbase4:35011] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:02:29,950 INFO [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:02:29,950 INFO [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:02:29,952 INFO [RS:0;jenkins-hbase4:35011] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 07:02:29,952 DEBUG [RS:1;jenkins-hbase4:33577] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ec81448 to 127.0.0.1:58805 2023-10-05 07:02:29,953 INFO [RS:0;jenkins-hbase4:35011] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 07:02:29,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing db466438afcbe211bce2591ee5f088a3, disabling compactions & flushes 2023-10-05 07:02:29,953 INFO [RS:0;jenkins-hbase4:35011] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 07:02:29,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3. 2023-10-05 07:02:29,953 DEBUG [RS:2;jenkins-hbase4:39927] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ca6f025 to 127.0.0.1:58805 2023-10-05 07:02:29,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 10f773d120b025203d205e5501cc214d, disabling compactions & flushes 2023-10-05 07:02:29,954 DEBUG [RS:2;jenkins-hbase4:39927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:02:29,954 INFO [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-05 07:02:29,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3. 2023-10-05 07:02:29,953 DEBUG [RS:1;jenkins-hbase4:33577] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:02:29,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3. after waiting 0 ms 2023-10-05 07:02:29,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3. 2023-10-05 07:02:29,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d. 2023-10-05 07:02:29,954 INFO [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-05 07:02:29,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing db466438afcbe211bce2591ee5f088a3 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-10-05 07:02:29,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d. 2023-10-05 07:02:29,954 DEBUG [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-10-05 07:02:29,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d. after waiting 0 ms 2023-10-05 07:02:29,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d. 2023-10-05 07:02:29,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 10f773d120b025203d205e5501cc214d 1/1 column families, dataSize=78 B heapSize=488 B 2023-10-05 07:02:29,955 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-05 07:02:29,955 INFO [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-05 07:02:29,955 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-05 07:02:29,955 INFO [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-05 07:02:29,955 DEBUG [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(1478): Online Regions={db466438afcbe211bce2591ee5f088a3=hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3.} 2023-10-05 07:02:29,955 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-05 07:02:29,955 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-05 07:02:29,955 DEBUG [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-05 07:02:29,955 DEBUG [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(1478): Online Regions={10f773d120b025203d205e5501cc214d=hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d.} 2023-10-05 07:02:29,955 DEBUG [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(1504): Waiting on db466438afcbe211bce2591ee5f088a3 2023-10-05 07:02:29,955 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-05 07:02:29,956 DEBUG [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(1504): Waiting on 10f773d120b025203d205e5501cc214d 2023-10-05 07:02:29,956 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-10-05 07:02:29,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/namespace/10f773d120b025203d205e5501cc214d/.tmp/info/f533b83c67b94183a4e483ca3400af40 2023-10-05 07:02:29,978 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/acl/db466438afcbe211bce2591ee5f088a3/.tmp/l/5b13454efbed480eba11294978cadbf9 2023-10-05 07:02:29,979 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/.tmp/info/0944acec5be84ae29043628db3c4ea7f 2023-10-05 07:02:29,984 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0944acec5be84ae29043628db3c4ea7f 2023-10-05 07:02:29,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/namespace/10f773d120b025203d205e5501cc214d/.tmp/info/f533b83c67b94183a4e483ca3400af40 as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/namespace/10f773d120b025203d205e5501cc214d/info/f533b83c67b94183a4e483ca3400af40 2023-10-05 07:02:29,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b13454efbed480eba11294978cadbf9 2023-10-05 07:02:29,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/acl/db466438afcbe211bce2591ee5f088a3/.tmp/l/5b13454efbed480eba11294978cadbf9 as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/acl/db466438afcbe211bce2591ee5f088a3/l/5b13454efbed480eba11294978cadbf9 2023-10-05 07:02:29,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/namespace/10f773d120b025203d205e5501cc214d/info/f533b83c67b94183a4e483ca3400af40, entries=2, sequenceid=6, filesize=4.8 K 2023-10-05 07:02:29,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 10f773d120b025203d205e5501cc214d in 36ms, sequenceid=6, compaction requested=false 2023-10-05 07:02:29,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b13454efbed480eba11294978cadbf9 2023-10-05 07:02:29,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/acl/db466438afcbe211bce2591ee5f088a3/l/5b13454efbed480eba11294978cadbf9, entries=7, sequenceid=18, filesize=5.2 K 2023-10-05 07:02:29,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for db466438afcbe211bce2591ee5f088a3 in 42ms, sequenceid=18, compaction requested=false 2023-10-05 07:02:30,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/namespace/10f773d120b025203d205e5501cc214d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-10-05 07:02:30,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:02:30,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d. 2023-10-05 07:02:30,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 10f773d120b025203d205e5501cc214d: 2023-10-05 07:02:30,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1696489210262.10f773d120b025203d205e5501cc214d. 2023-10-05 07:02:30,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/acl/db466438afcbe211bce2591ee5f088a3/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-10-05 07:02:30,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:02:30,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3. 2023-10-05 07:02:30,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for db466438afcbe211bce2591ee5f088a3: 2023-10-05 07:02:30,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1696489211004.db466438afcbe211bce2591ee5f088a3. 2023-10-05 07:02:30,006 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 07:02:30,006 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 07:02:30,006 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-05 07:02:30,156 DEBUG [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-05 07:02:30,156 INFO [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39927,1696489208029; all regions closed. 2023-10-05 07:02:30,156 INFO [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33577,1696489207986; all regions closed. 2023-10-05 07:02:30,167 DEBUG [RS:1;jenkins-hbase4:33577] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/oldWALs 2023-10-05 07:02:30,167 DEBUG [RS:2;jenkins-hbase4:39927] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/oldWALs 2023-10-05 07:02:30,168 INFO [RS:2;jenkins-hbase4:39927] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39927%2C1696489208029:(num 1696489209792) 2023-10-05 07:02:30,167 INFO [RS:1;jenkins-hbase4:33577] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33577%2C1696489207986:(num 1696489209792) 2023-10-05 07:02:30,168 DEBUG [RS:2;jenkins-hbase4:39927] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:02:30,168 DEBUG [RS:1;jenkins-hbase4:33577] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:02:30,168 INFO [RS:2;jenkins-hbase4:39927] regionserver.LeaseManager(133): Closed leases 2023-10-05 07:02:30,168 INFO [RS:1;jenkins-hbase4:33577] regionserver.LeaseManager(133): Closed leases 2023-10-05 07:02:30,168 INFO [RS:1;jenkins-hbase4:33577] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-05 07:02:30,168 INFO [RS:2;jenkins-hbase4:39927] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-10-05 07:02:30,169 INFO [RS:2;jenkins-hbase4:39927] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 07:02:30,169 INFO [RS:1;jenkins-hbase4:33577] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-05 07:02:30,169 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 07:02:30,169 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 07:02:30,169 INFO [RS:2;jenkins-hbase4:39927] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 07:02:30,169 INFO [RS:2;jenkins-hbase4:39927] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 07:02:30,169 INFO [RS:1;jenkins-hbase4:33577] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-05 07:02:30,169 INFO [RS:1;jenkins-hbase4:33577] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-05 07:02:30,170 INFO [RS:2;jenkins-hbase4:39927] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39927 2023-10-05 07:02:30,171 INFO [RS:1;jenkins-hbase4:33577] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33577 2023-10-05 07:02:30,176 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:02:30,177 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 07:02:30,177 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 07:02:30,176 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:02:30,177 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 07:02:30,176 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33577,1696489207986 2023-10-05 07:02:30,177 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 07:02:30,177 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:02:30,177 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:02:30,177 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39927,1696489208029 2023-10-05 07:02:30,180 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33577,1696489207986] 2023-10-05 07:02:30,180 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33577,1696489207986; numProcessing=1 2023-10-05 07:02:30,181 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33577,1696489207986 already deleted, retry=false 2023-10-05 07:02:30,182 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33577,1696489207986 expired; onlineServers=2 2023-10-05 07:02:30,182 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39927,1696489208029] 2023-10-05 07:02:30,182 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39927,1696489208029; numProcessing=2 2023-10-05 07:02:30,183 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39927,1696489208029 already deleted, retry=false 2023-10-05 07:02:30,183 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39927,1696489208029 expired; onlineServers=1 2023-10-05 07:02:30,280 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 07:02:30,280 INFO [RS:1;jenkins-hbase4:33577] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33577,1696489207986; zookeeper connection closed. 2023-10-05 07:02:30,280 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:33577-0x101156226bf0002, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 07:02:30,280 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@91e5701] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@91e5701 2023-10-05 07:02:30,356 DEBUG [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-05 07:02:30,380 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 07:02:30,380 INFO [RS:2;jenkins-hbase4:39927] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39927,1696489208029; zookeeper connection closed. 2023-10-05 07:02:30,380 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:39927-0x101156226bf0003, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 07:02:30,380 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@71300d2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@71300d2 2023-10-05 07:02:30,399 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/.tmp/rep_barrier/3cb53cdabaf046aeb9ba618b7b10b4d4 2023-10-05 07:02:30,404 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3cb53cdabaf046aeb9ba618b7b10b4d4 2023-10-05 07:02:30,413 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/.tmp/table/69ce1fbf4442447bbf36fc1e7532f15e 2023-10-05 07:02:30,417 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69ce1fbf4442447bbf36fc1e7532f15e 2023-10-05 07:02:30,418 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/.tmp/info/0944acec5be84ae29043628db3c4ea7f as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/info/0944acec5be84ae29043628db3c4ea7f 2023-10-05 07:02:30,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0944acec5be84ae29043628db3c4ea7f 2023-10-05 07:02:30,423 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/info/0944acec5be84ae29043628db3c4ea7f, entries=48, sequenceid=131, filesize=10.3 K 2023-10-05 07:02:30,423 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/.tmp/rep_barrier/3cb53cdabaf046aeb9ba618b7b10b4d4 as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/rep_barrier/3cb53cdabaf046aeb9ba618b7b10b4d4 2023-10-05 07:02:30,428 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3cb53cdabaf046aeb9ba618b7b10b4d4 2023-10-05 07:02:30,428 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/rep_barrier/3cb53cdabaf046aeb9ba618b7b10b4d4, entries=13, sequenceid=131, filesize=6.4 K 2023-10-05 07:02:30,429 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/.tmp/table/69ce1fbf4442447bbf36fc1e7532f15e as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/table/69ce1fbf4442447bbf36fc1e7532f15e 2023-10-05 07:02:30,433 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69ce1fbf4442447bbf36fc1e7532f15e 2023-10-05 07:02:30,433 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/table/69ce1fbf4442447bbf36fc1e7532f15e, entries=24, sequenceid=131, filesize=6.9 K 2023-10-05 07:02:30,434 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 478ms, sequenceid=131, compaction requested=false 2023-10-05 07:02:30,444 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-10-05 07:02:30,445 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-10-05 07:02:30,445 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-05 07:02:30,445 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-05 07:02:30,445 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-05 07:02:30,445 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-05 07:02:30,556 INFO [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35011,1696489207914; all regions closed. 2023-10-05 07:02:30,561 DEBUG [RS:0;jenkins-hbase4:35011] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/oldWALs 2023-10-05 07:02:30,561 INFO [RS:0;jenkins-hbase4:35011] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35011%2C1696489207914.meta:.meta(num 1696489209970) 2023-10-05 07:02:30,567 DEBUG [RS:0;jenkins-hbase4:35011] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/oldWALs 2023-10-05 07:02:30,567 INFO [RS:0;jenkins-hbase4:35011] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35011%2C1696489207914:(num 1696489209792) 2023-10-05 07:02:30,567 DEBUG [RS:0;jenkins-hbase4:35011] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:02:30,567 INFO [RS:0;jenkins-hbase4:35011] regionserver.LeaseManager(133): Closed leases 2023-10-05 07:02:30,567 INFO [RS:0;jenkins-hbase4:35011] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-05 07:02:30,567 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 07:02:30,568 INFO [RS:0;jenkins-hbase4:35011] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35011 2023-10-05 07:02:30,572 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35011,1696489207914 2023-10-05 07:02:30,572 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-05 07:02:30,574 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35011,1696489207914] 2023-10-05 07:02:30,574 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35011,1696489207914; numProcessing=3 2023-10-05 07:02:30,576 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35011,1696489207914 already deleted, retry=false 2023-10-05 07:02:30,576 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35011,1696489207914 expired; onlineServers=0 2023-10-05 07:02:30,576 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33507,1696489206530' ***** 2023-10-05 07:02:30,576 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-05 07:02:30,577 DEBUG [M:0;jenkins-hbase4:33507] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@194513aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-10-05 07:02:30,577 INFO [M:0;jenkins-hbase4:33507] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33507,1696489206530 2023-10-05 07:02:30,577 INFO [M:0;jenkins-hbase4:33507] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33507,1696489206530; all regions closed. 2023-10-05 07:02:30,577 DEBUG [M:0;jenkins-hbase4:33507] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-05 07:02:30,577 DEBUG [M:0;jenkins-hbase4:33507] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-05 07:02:30,577 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-05 07:02:30,577 DEBUG [M:0;jenkins-hbase4:33507] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-05 07:02:30,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696489209435] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1696489209435,5,FailOnTimeoutGroup] 2023-10-05 07:02:30,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696489209435] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1696489209435,5,FailOnTimeoutGroup] 2023-10-05 07:02:30,577 INFO [M:0;jenkins-hbase4:33507] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-05 07:02:30,577 INFO [M:0;jenkins-hbase4:33507] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-05 07:02:30,577 INFO [M:0;jenkins-hbase4:33507] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-10-05 07:02:30,577 DEBUG [M:0;jenkins-hbase4:33507] master.HMaster(1512): Stopping service threads 2023-10-05 07:02:30,577 INFO [M:0;jenkins-hbase4:33507] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-05 07:02:30,578 ERROR [M:0;jenkins-hbase4:33507] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-16,5,PEWorkerGroup] 2023-10-05 07:02:30,578 INFO [M:0;jenkins-hbase4:33507] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-05 07:02:30,578 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-05 07:02:30,579 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-05 07:02:30,579 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-05 07:02:30,579 DEBUG [M:0;jenkins-hbase4:33507] zookeeper.ZKUtil(398): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-05 07:02:30,579 WARN [M:0;jenkins-hbase4:33507] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-05 07:02:30,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-05 07:02:30,580 INFO [M:0;jenkins-hbase4:33507] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-05 07:02:30,580 INFO [M:0;jenkins-hbase4:33507] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-05 07:02:30,580 DEBUG [M:0;jenkins-hbase4:33507] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-05 07:02:30,580 INFO [M:0;jenkins-hbase4:33507] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 07:02:30,580 DEBUG [M:0;jenkins-hbase4:33507] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 07:02:30,581 DEBUG [M:0;jenkins-hbase4:33507] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-05 07:02:30,581 DEBUG [M:0;jenkins-hbase4:33507] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 07:02:30,581 INFO [M:0;jenkins-hbase4:33507] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.90 KB heapSize=452.16 KB 2023-10-05 07:02:30,593 INFO [M:0;jenkins-hbase4:33507] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.90 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/100997bff3294e39aba103756332f772 2023-10-05 07:02:30,597 INFO [M:0;jenkins-hbase4:33507] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 100997bff3294e39aba103756332f772 2023-10-05 07:02:30,597 DEBUG [M:0;jenkins-hbase4:33507] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/100997bff3294e39aba103756332f772 as hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/100997bff3294e39aba103756332f772 2023-10-05 07:02:30,601 INFO [M:0;jenkins-hbase4:33507] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 100997bff3294e39aba103756332f772 2023-10-05 07:02:30,601 INFO [M:0;jenkins-hbase4:33507] regionserver.HStore(1080): Added hdfs://localhost:41859/user/jenkins/test-data/e4fe9463-b8c8-ff96-48f1-8111f746eba0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/100997bff3294e39aba103756332f772, entries=119, sequenceid=899, filesize=28.7 K 2023-10-05 07:02:30,602 INFO [M:0;jenkins-hbase4:33507] regionserver.HRegion(2948): Finished flush of dataSize ~375.90 KB/384917, heapSize ~452.15 KB/463000, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=899, compaction requested=false 2023-10-05 07:02:30,603 INFO [M:0;jenkins-hbase4:33507] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-05 07:02:30,603 DEBUG [M:0;jenkins-hbase4:33507] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-05 07:02:30,606 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-05 07:02:30,606 INFO [M:0;jenkins-hbase4:33507] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-05 07:02:30,607 INFO [M:0;jenkins-hbase4:33507] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33507 2023-10-05 07:02:30,610 DEBUG [M:0;jenkins-hbase4:33507] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33507,1696489206530 already deleted, retry=false 2023-10-05 07:02:30,674 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 07:02:30,674 INFO [RS:0;jenkins-hbase4:35011] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35011,1696489207914; zookeeper connection closed. 2023-10-05 07:02:30,674 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): regionserver:35011-0x101156226bf0001, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 07:02:30,675 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@66198350] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@66198350 2023-10-05 07:02:30,675 INFO [Listener at jenkins-hbase4.apache.org/36167] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-10-05 07:02:30,775 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 07:02:30,775 DEBUG [Listener at localhost/45249-EventThread] zookeeper.ZKWatcher(600): master:33507-0x101156226bf0000, quorum=127.0.0.1:58805, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-05 07:02:30,775 INFO [M:0;jenkins-hbase4:33507] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33507,1696489206530; zookeeper connection closed. 2023-10-05 07:02:30,776 WARN [Listener at jenkins-hbase4.apache.org/36167] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 07:02:30,780 INFO [Listener at jenkins-hbase4.apache.org/36167] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 07:02:30,884 WARN [BP-375357806-172.31.14.131-1696489202396 heartbeating to localhost/127.0.0.1:41859] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 07:02:30,884 WARN [BP-375357806-172.31.14.131-1696489202396 heartbeating to localhost/127.0.0.1:41859] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-375357806-172.31.14.131-1696489202396 (Datanode Uuid 34081589-a41c-4139-8fbc-7cd6c977aca1) service to localhost/127.0.0.1:41859 2023-10-05 07:02:30,886 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/cluster_7c69a4d7-26dc-b96d-a4e0-1faad6f9ad3a/dfs/data/data5/current/BP-375357806-172.31.14.131-1696489202396] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 07:02:30,886 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/cluster_7c69a4d7-26dc-b96d-a4e0-1faad6f9ad3a/dfs/data/data6/current/BP-375357806-172.31.14.131-1696489202396] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 07:02:30,887 WARN [Listener at jenkins-hbase4.apache.org/36167] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 07:02:30,890 INFO [Listener at jenkins-hbase4.apache.org/36167] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 07:02:30,993 WARN [BP-375357806-172.31.14.131-1696489202396 heartbeating to localhost/127.0.0.1:41859] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 07:02:30,993 WARN [BP-375357806-172.31.14.131-1696489202396 heartbeating to localhost/127.0.0.1:41859] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-375357806-172.31.14.131-1696489202396 (Datanode Uuid 28a7f23f-f330-48f0-b24e-933d50ddaadb) service to localhost/127.0.0.1:41859 2023-10-05 07:02:30,994 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/cluster_7c69a4d7-26dc-b96d-a4e0-1faad6f9ad3a/dfs/data/data3/current/BP-375357806-172.31.14.131-1696489202396] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 07:02:30,994 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/cluster_7c69a4d7-26dc-b96d-a4e0-1faad6f9ad3a/dfs/data/data4/current/BP-375357806-172.31.14.131-1696489202396] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 07:02:30,995 WARN [Listener at jenkins-hbase4.apache.org/36167] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-05 07:02:30,997 INFO [Listener at jenkins-hbase4.apache.org/36167] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 07:02:31,100 WARN [BP-375357806-172.31.14.131-1696489202396 heartbeating to localhost/127.0.0.1:41859] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-05 07:02:31,100 WARN [BP-375357806-172.31.14.131-1696489202396 heartbeating to localhost/127.0.0.1:41859] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-375357806-172.31.14.131-1696489202396 (Datanode Uuid 682edfc3-4d10-40b5-a6fe-b057e11b7677) service to localhost/127.0.0.1:41859 2023-10-05 07:02:31,101 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/cluster_7c69a4d7-26dc-b96d-a4e0-1faad6f9ad3a/dfs/data/data1/current/BP-375357806-172.31.14.131-1696489202396] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 07:02:31,101 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/3fccf068-d6bd-a08f-98c5-ade428fd4ac4/cluster_7c69a4d7-26dc-b96d-a4e0-1faad6f9ad3a/dfs/data/data2/current/BP-375357806-172.31.14.131-1696489202396] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-05 07:02:31,122 INFO [Listener at jenkins-hbase4.apache.org/36167] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-05 07:02:31,248 INFO [Listener at jenkins-hbase4.apache.org/36167] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-05 07:02:31,344 INFO [Listener at jenkins-hbase4.apache.org/36167] hbase.HBaseTestingUtility(1293): Minicluster is down